Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Craigslist
Aftercare Teacher - Montessori (Millis)
Aftercare Teacher wanted at Woodside Montessori Academy Woodside Montessori Academy is seeking a creative, caring, and dedicated aftercare teacher to join our team. The ideal candidate will be independent, inquisitive, professional, patient, and able to work collaboratively with colleagues. We value positive problem solvers who foster a nurturing environment and support our students’ growth. Position Details: Hours: 2:30 PM - 6 PM, Monday through Friday Schedule: Part-time, approximately 15-20 hours/week Compensation: $20/hour Location: 350 Village St, Millis, MA 02054 Qualifications: Must have EEC teacher certification (Montessori credential preferred) Ability to work effectively in a multi-age environment Open to incorporating the Montessori Method Excellent communication skills and a good sense of humor are essential! Benefits: 5 days PTO Tuition discount AFLAC (employee-paid) About Woodside Montessori Academy: Founded in 1985, Woodside Montessori Academy offers a full Montessori educational experience for students from age three through eighth grade. We provide a challenging and stimulating environment guided by knowledgeable and caring faculty. Our curriculum emphasizes individualized learning, hands-on experiences, and real-world applications, fostering lifelong learners and well-rounded students. Our diverse community values respect, inclusion, and the development of each student’s potential as a responsible global citizen. The Role of the Aftercare Teacher: In our Montessori environment, the teacher serves as a model, facilitator, and observer. Building respectful and trusting relationships with students helps boost their confidence. The teacher plans and maintains a prepared environment that encourages independence, social interaction, and academic growth. Observant and attentive, the teacher individualizes support and smoothly transitions students through activities, fostering personal development. Join Our Team! If you’re passionate about education, enthusiastic about supporting children’s growth, and thrive in a collaborative setting, we encourage you to apply. Help us nurture curious, confident, and compassionate learners at Woodside Montessori Academy! Learn more about us here! To Apply: Please submit your resume and a brief cover letter highlighting your relevant experience and why you're interested in this position to Grace@lifebydesignvs.com Woodside Montessori Academy is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees and students.
37 Exchange St, Millis, MA 02054, USA
$20/hour
Workable
Senior Python Developer
As a Senior Python Developer, you will work with our application and collaborate with third-party teams to integrate our application with theirs. Our backend is a set of APIs consumed by various frontend React applications, including online ordering websites, mobile apps, and in-store ordering kiosks. We have three main APIs, each quite large: Admin API (for the admin panel), Order API (for e-commerce products), and In-store API (for our in-store products, including kiosks and kitchen display systems). The main application is based on Flask and uses MySQL for its database. We do not use an ORM to talk to the database, so you must be well-versed in writing SQL and working directly with a database to be effective. Integrating with APIs provided by the backend team to provide seamless connections between our applications. Integrating with external APIs directly. Expanding the capabilities of our REST APIs: building new endpoints using the OpenAPI specification. Building new backend functionalities to help expand the feature set of our customer-facing products. Improving the end-user experience by reducing the latency of API endpoints using all tools available (SQL queries, indices, caching, background tasks, Datadog APM, etc.). Tracking down and fixing bugs encountered by end users. Refactoring parts of the application that require modernization. Expanding the scope and coverage of the automated test suite. Requirements Powerful written and verbal communication skills. 5-10 years as a Python Developer. Experience with Flask or Django, with a strong preference for Flask experience. A thorough understanding of working directly with databases and writing custom SQL queries. Experience working on a consumer-facing application with high-performance requirements. Experience integrating with external APIs for payments and other non-core features. Experience working on an e-commerce application, preferably in the restaurant or retail industry. Knowledge of and experience with CRM and/or loyalty & marketing applications, directly or indirectly by integrating with such systems. Hands-on experience with Celery, Redis, Docker, Linux, and AWS is a plus. Experience working with an established code base and taking ownership of certain parts of the code base (if you have only worked on projects built from scratch, this role is not for you). Ability to work independently with minimal supervision: You should be a self-starter who doesn’t require constant oversight to stay on task and enjoys solving problems primarily on your own. BSc in Computer Science, Engineering, or relevant field. The employee needs to be available until at least 4 pm. US Eastern Time. Since we hire from across the world, our employees need to coordinate and be present in real time. 100% Remote $180,000 - $200,000 Benefits Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k) Life Insurance (Basic, Voluntary & AD&D) Flexible Paid Time Off Family Leave (Maternity, Paternity) Short Term & Long Term Disability Training & Development Work From Home Stock Option Plan
New York, NY, USA
$180,000-200,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.