Join a project focused on building a robust food ingredient database for a new app inspired by food scanners. The role centers on developing a backend solution to legally and efficiently scrape food item and ingredient data from major grocery retail websites. The collected data will be structured and stored in a MySQL or PostgreSQL database, supporting the app’s mission to provide users with detailed ingredient insights. The ideal candidate will have strong experience in Python and Django, with a proven track record in web scraping and data management. This is a single-project opportunity, perfect for a developer who thrives on building practical, scalable solutions for real-world applications.
Responsibilities
* Design and implement a backend program to scrape food item and ingredient data from leading grocery retail websites
* Ensure all scraping activities comply with legal and ethical standards
* Develop a system to accept URLs and automate the extraction and storage of food data on each run
* Structure and store the scraped data in a MySQL or PostgreSQL database for easy retrieval and analysis
* Optimize scraping scripts for reliability, efficiency, and scalability
* Collaborate on defining data categories and database schema to support app requirements
* Document the scraping process, codebase, and database structure for future maintenance
Skills And Requirements
* Proficient in Python and Django, with hands-on experience in backend development
* Demonstrated expertise in web scraping using libraries such as BeautifulSoup, Scrapy, or Selenium
* Strong understanding of data storage and management with MySQL or PostgreSQL
* Knowledge of legal and ethical considerations in web scraping
* Ability to design and implement scalable, maintainable code
* Familiarity with RESTful APIs and data integration best practices
* Excellent problem-solving skills and attention to detail
* Self-motivated and able to deliver high-quality results independently
* Availability for a single-project engagement, with flexibility to adapt to evolving requirements
About Twine
Twine is a leading freelance marketplace connecting top freelancers, consultants, and contractors with companies needing creative and tech expertise. Trusted by Fortune 500 companies and innovative startups alike, Twine enables companies to scale their teams globally.
Our Mission
Twine's mission is to empower creators and businesses to thrive in an AI-driven, freelance-first world.