Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
EAM Project Manager - Transportation
EAM Project Manager - Transportation Location: New York, NY (Hybrid – 2 days on-site per week) Schedule: Monday–Friday, 9 AM–5 PM Compensation: $55–$85/hour (1099) Term: 12+ month contract Description We are seeking an experienced and highly skilled EAM Project Manager to lead a major rail and transit client engagement in the New York area. The successful candidate will manage the full lifecycle of an Enterprise Asset Management (EAM) system implementation with a strong focus on Hexagon EAM. This role requires a balance of technical oversight, stakeholder engagement, and governance expertise to ensure successful delivery, integration, and compliance. Key Responsibilities Project Leadership & Delivery Manage the full lifecycle of the EAM system implementation project (Hexagon EAM). Lead stakeholder engagement across diverse cross-functional teams. Develop and maintain project plans, risk registers, and change logs. Technical Oversight Ensure successful integration with GIS and work management systems. Oversee data migration, validation, and system configuration. Support testing, training, and go-live activities. Compliance & Governance Ensure adherence to regulatory frameworks (e.g., FRA, FTA, ISO 55000). Maintain accurate documentation for audits, traceability, and benefit realization. Facilitate governance board reviews and provide updates to steering committees. Requirements Minimum Qualifications Bachelor’s degree in Engineering, Business, or Information Systems. 10+ years of project management experience in asset-intensive industries. Proven expertise with EAM systems (Hexagon, Maximo, or similar) and infrastructure lifecycle planning. Strong analytical, documentation, and stakeholder management skills. Demonstrated leadership ability in complex environments. Eligible to work in the U.S. and pass a background check. Preferred Qualifications PMP or equivalent project management certification. Previous experience in rail, utilities, or public infrastructure sectors. Benefits Long-term opportunity (12+ months). Hybrid schedule: Monday–Friday, 9 AM–5 PM, with 2 days per week on-site. Compensation (1099): $55–$85 per hour (based on experience).
New York, NY, USA
$55-85/day
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.