Title: There are existing HN job aggregators, but I thought we could take it a step further.
Inspired by an insightful comment on a previous thread (<a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=36163021">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=36163021</a>), I built a tool that aggregates job postings and intelligently categorizes them based on user-specific preferences:<p>* Country and remote work preferences<p>* Employer type (e.g., startup, corporation, government)<p>* Industry<p>* Technologies used<p>* Role type (developer, architect, product owner, etc.)<p>* Salary range (where available)<p>One of the superpowers of LLMs is reformatting information from any format X to any other format Y.
We leverage this to map all the unstructured job postings into the same unified structure. The new GPT functions feature and the extended context windows are really helpful for this.
Instead of having to build a custom NER pipeline, it works very well with GPT out-of-the box.<p>One challenge is keeping the filters consistent and merging of duplicates. Embeddings help with that.<p>What&#x27;s next:<p>* Integrate additional sources. We can generate web scrapers and data processing steps on the fly that extract and transform data into the same structure.<p>* Add location distance filters.<p>* Expand beyond jobs to monitor personalized data like events or real estate. Imagine using AI to rate local events from multiple sources based on your preferences, considering factors like your interests and distance from home.<p>* Smaller improvements based on your feedback :)
Upvote: