Czechitas is a Czech non-profit organization of women and men on a mission to reach a higher level of digital proficiency among women and the new generation. See how they teamed up with Apify for the ultimate job scraping job.

Bringing IT opportunities closer to women  · Success stories · Apify

[Czechitas](https://www.czechitas.cz/en) is a Czech non-profit organization of women and men on a mission to promote and increase diversity in IT industry and reach a higher level of digital proficiency among women and the new generation. They organize programming courses and workshops and have a wide partnership network helping their graduates in finding the right employment opportunities in the field. 

## Challenge: scrape job advertisements  

“All roads lead to Czechitas, but some of them take too long” [project ](https://team2martinatereza.medium.com/v%C5%A1echny-cesty-vedou-do-czechitas-8530d54320ab) was created as a part of the “[Czechitas Digital Academy: Data](https://www.czechitas.cz/tema/digitalni-akademie)” study program. The project goal was to optimize Czechitas branch structure in order to make their courses more accessible for potential participants. The project was kicked off with analyzing commuting times from all around the Czech Republic to current and possible future locations of Czechitas’ offices. But to get the full picture, as the second part of the plan, it was also necessary to collect and analyze posted job advertisements for junior IT positions all over the country in respective cities. This was the moment they realized web scraping could simplify this task for them.

![stavajici pobocky.png](https://cdn-cms.apify.com/stavajici_pobocky_3f4b7e51ec.png)

## Solution: customized web scraping and automation

Apify has been a long-time [partner ](https://www.czechitas.cz/tema/digitalni-akademie) for Czechitas and stepped in as a mentor for this part of the project. With their advisory and support, Czechitas created their own actor to scrape [startupjobs.cz](https://www.startupjobs.cz/?gclid=EAIaIQobChMIw6Gbm6Kw8QIVrAZ7Ch3XJAzREAAYASAAEgIi0vD_BwE), an advertisement platform dedicated to job search specifically in IT industry. Czechitas started with a universal [apify/web-scraper](https://apify.com/apify/web-scraper) which has been modified according to their request. It took some time to finetune all the details, but they managed to scrape job advertisement content in its entirety on the website with preserved information structure as follows:
- position name, company
- location, possibility to work remotely
- scope of work
- form of cooperation
- required language skills
- seniority
- remuneration
- job description (full text)
- issue date of the advertisement 
- url of the advertisement

![juniors it scraping.png](https://cdn-cms.apify.com/juniors_it_scraping_87476b9e12.png)

## Hidden pitfalls

The last one, tricky part of the scraping process was pagination which Czechitas figured out in the process. It turned out that the startupjobs.cz home-page actually stated the number of advertisements to display, so with a set number of items per page the website was rather easy to get through. 

All scraped information was downloaded in JSON format. For further clearing, transformation and categorization, this dataset was also uploaded to [Keboola ](https://www.keboola.com/) (directly via its dedicated [Apify extractor](https://apify.com/integrations)). All data transformations have been made in Keboola via Snowflake SQL and the optimized dataset was then exported to Tableau to perform final visualizations.
Once everything was working smoothly, Czechitas automated all the above-mentioned steps. They scheduled the actor in Apify to run repeatedly, and set up orchestration in Keboola to extract and transform data. These processes ensured that the resulting .tbe file regularly filled up with new data, and therefore always remained up-to-date.


![image (2).png](https://cdn-cms.apify.com/image_2_fff74e68a9.png)


large_czechitas_cover.png

medium_czechitas_cover.png

small_czechitas_cover.png

thumbnail_czechitas_cover.png

czechitas_cover.png

large_image (2).png

medium_image (2).png

small_image (2).png

thumbnail_image (2).png

image (2).png

Thanks to this automated workflow, we can now analyze current job trends on the IT market. This helps Czechitas to make the right decisions about opening up new offices and targeting the right audience for their courses. It has been a wonderful experience to work with our Apify mentors and we’re looking forward to new ambitious scraping projects. 


Bringing IT opportunities closer to women 

Bringing IT opportunities closer to women

Interested in how Apify can help your organization?

Where next?