Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Craigslist
Class A Yard Driver - $24/hr (Bryan, TX)
NOW HIRING CLASS A YARD TRUCK DRIVERS!   Now Hiring Class A Yard Drivers - Bryan, Tx Class A Yard Hostler - Full-Time Pay: $24/hour Schedule: Sunday - Wednesday 6a - 6p 42hrs/week Description: We’re looking for a reliable Class A Yard Driver to join our team. You’ll be responsible for operating a Yard Goat, transporting loads around the yard, or a very short distance to another facility. This is a great opportunity for those looking for part time work who enjoy a steady, local job and working independently. Responsibilities: Safely operate a Class A Yard Hostler Commute short distances Perform pre- and post-trip vehicle inspections Maintain accurate logs and paperwork Interact professionally with warehouse staff and drivers  What We Offer: $24/hour 4 Days a week Supportive team environment Opportunities for advancement  Qualifications: Minimum 12 months of Class A experience within the last 2 years Satisfactory Employment Verifications for the past 3 years. Satisfactory Driving Record subject to TCI's Safety Insurance Criteria  Benefits & Perks: Weekly Pay with Direct Deposit Safety Incentives – Earn up to $1,200 extra per year Driver Referral Bonus Program Comprehensive Benefits Package – Medical, Dental & Vision Company-Paid Life and AD&D Insurance 401(k) with Company Match Earned Paid Time Off (PTO) Paid Holidays Employee Discounts through LifeMart4  About Us:  We are a family-owned company doing business since 1978. Our core values are the foundation of who we are as a team and how we do business. We are dedicated and committed to safety, each other, and our customers. Our team is positive and passionate and come to work each day with a “Can Do” attitude. We strive to be creative problem solvers who bring innovative thinking in all our work. Being ethical, transparent, and accountable has helped shape our team and how we do business. We are looking for more people that match our core values to join our team.
MGCC+C2 Bryan, TX, USA
$24/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.