Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
iOS Developer - W2 Contract
Role: iOS Developer Location: Dallas TX - Onsite Position Type: Contract – Only W2 Job Description: Preferred Skills: - 5+ years of experience as an iOS Mobile Developer, with expertise in developing and deploying production-grade mobile applications. - Strong proficiency in Swift and SwiftUI and Objective-C for iOS development. - Experience integrating mobile with backend services via RESTful APIs and cloud-based solutions. - Knowledge of secure coding practices for mobile apps to ensure user data protection. - Familiarity with CI/CD tools, such as Jenkins or Azure DevOps. - Experience with mobile app monitoring, analytics, and debugging tools. - Knowledge of iOS app store submission guidelines and troubleshooting potential app rejections. - Strong understanding of mobile offline storage, app performance optimization, UI/UX best practices, and ensuring smooth user interactions. - Knowledge of AI/ML, LLMs, and GenAI applications. - Experience with Android development is a plus. Preferred Skills: - 5+ years of experience as an iOS Mobile Developer, with expertise in developing and deploying production-grade mobile applications. - Strong proficiency in Swift and SwiftUI and Objective-C for iOS development. - Experience integrating mobile with backend services via RESTful APIs and cloud-based solutions. - Knowledge of secure coding practices for mobile apps to ensure user data protection. - Familiarity with CI/CD tools, such as Jenkins or Azure DevOps. - Experience with mobile app monitoring, analytics, and debugging tools. - Knowledge of iOS app store submission guidelines and troubleshooting potential app rejections. - Strong understanding of mobile offline storage, app performance optimization, UI/UX best practices, and ensuring smooth user interactions. - Knowledge of AI/ML, LLMs, and GenAI applications. - Experience with Android development is a plus.
Dallas, TX, USA
Negotiable Salary
Craigslist
Startup Opportunity: Website Developer & Project Manager (BURLINGTON)
We’re an Skagit County established "Wholesale Supply" company in need of a tech division startup in the final stages of launching our 15 ecommerce websites and promotions platforms (national, data-driven marketplace technology connecting with businesses and customers). The foundations are already built and we’re seeking top-tier experts with vast e-commerce and tech-savy skills to take over, refine, and drive this project to market success. We estimate $2-10 million in revenue from online sales. REQUIREMENTS Complete Web Development Expertise: Ability to quickly understand and take ownership of an existing back end, front end, codebase from overseas developers and implement AI-Driven Feature Knowledge: Experience integrating AI tools and personalization algorithms. Project Leadership: Comfort managing offshore development teams to outsource specialized features while ensuring top-quality delivery. Technical Versatility: Strong knowledge of scalable cloud infrastructure, backend APIs, frontend frameworks, and payment integrations. Strategic Vision: Someone excited to grow with a startup, bring fresh ideas, and eventually take on equity/percentage ownership. RESPONSIBILITIES Take over and transform older live, near-complete web platforms to the newly developed platforms and/or implement them online Work closely with the original developer (available for initial support) to ensure a smooth handover. Oversee new feature development and performance optimization. Help shape and execute product strategy while scaling the platform. REQUIREMENTS Proven track record. Strong technical leadership and communication skills. Familiarity with all ecommerce tools for personalization and customer engagement. Experience managing or working with outsourced development teams. Must be Whatcom/Skagit based or able to collaborate on Pacific Time. P/T or F/T
504 N Burlington Blvd, Burlington, WA 98233, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.