Collecting Web Data at USYD Online

Event Information

Share this event

Date and Time



Online Event

Event description
Collecting Web Data

About this Event

This training program is supported by the Deputy Vice Chancellor (Research) of the University of Sydney. Placements will be prioritised for researchers and research students at the University of Sydney. Registrants who are not researchers or research students at the University of Sydney may be moved to the waitlist. Thank you for your understanding. Please keep an eye on the Intersect website for upcoming courses at your home institution.

This course has two sessions:

  • 9:30 am - 12:45 pm on 22 Oct
  • 9:30 am - 12:45 pm on 23 Oct

An optional technical support on setting up Anaconda will start at 9 am on 22 Oct.

Why do this course?

Web scraping is a technique for extracting information from websites. This can be done manually but it is usually faster, more efficient and less error-prone if it can be automated.

Web scraping allows you to convert non-tabular or poorly structured data into a usable, structured format, such as a .csv file or spreadsheet. But scraping is about more than just acquiring data: it can help you track changes to data online, and help you archive data. In short, it’s a skill worth learning.

So join us for this web scraping workshop to learn web scraping, using the researcher-focused training modules from the highly regarded Software Carpentry Foundation (

You’ll learn how to:

  • Work on structured data in the websites.

  • Use XPath queries on HTML documents.

  • Scrape data using browser extensions.

  • Scrape data using Python and Scrapy.

  • Automate the scraping of multiple web pages.

The Intersect approach to training

At Intersect, we work closely with our member universities to develop and deliver training that targets the day-to-day software and technology problems that researchers face. We deliver hands-on courses in a relaxed setting with knowledgeable, helpful trainers who are themselves researchers and who know how researchers work. 

For more information about this course and others, see our course catalogue, or visit

Date and Time


Online Event

Save This Event

Event Saved