Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
SAP Payroll Technical
We are seeking a highly skilled Payroll Technical Consultant with extensive experience in US Payroll. The ideal candidate will have a strong background in ABAP HR code development and a deep understanding of Core HR and Payroll modules. This role involves designing and developing custom HR-ABAP programs, working with PNP/PNPCE logical databases, and enhancing payroll processes. • Experience: 9-15 years in payroll technical consulting. • ABAP HR Development: Proficient in ABAP HR code development. • Custom Programs: Design and write HR-ABAP custom programs; modify standard programs as needed. • Database Programming: Experience with PNP/PNPCE logical databases and cluster programming for Core HR, payroll, and time management. • Core HR & Payroll Knowledge: In-depth knowledge of Core HR and Payroll modules, including schemas, functions, and operations. • HR Tables/Clusters: Familiarity with HR, Core HR, and Payroll tables/clusters; experience in developing reports/BDC in the HR module. • Payroll Processes: Strong experience in Core HR and payroll processes, including preparing payroll reports. • Reports & Interfaces: Design and develop reports, interfaces, info types, and enhancements. • Team Development: Guide and develop team members to enhance their technical capabilities and productivity. • Forms Experience: Hands-on experience with SMART forms and HR forms. • User Exits & BAPIs: Proficient in user exits, BADi, and BAPI. • OOPS Concept: Strong understanding of object-oriented programming concepts. • Technical Documentation: Experience in requirement gathering, designing technical documents, unit testing, and code review. • Qualifications: • Bachelor’s degree in computer science, Information Technology, or a related field. • Proven experience in payroll technical consulting with a focus on US Payroll. • Excellent problem-solving skills and attention to detail. Strong communication and interpersonal skills.
Burbank, CA, USA
Negotiable Salary
Craigslist
Software Development Career (Remote) 🧑‍💻
We are seeking career-focused individuals ready to enter the field of technology. This program is ideal if you want to gain real-world coding skills, finish professional projects, and prepare for software and web developer roles. The program is remote and flexible—choose full-time or part-time—offering nearly 900 hours of guided training and project-based work. You’ll practice industry-standard coding languages, developer tools, and workflows while building a strong portfolio and resume to help you get hired. 🖥️ Technology & Programming Fundamentals • Understand how computers, networks, browsers, and the internet work • Learn algorithms, data structures, number systems, and security topics • Hands-on coding with Python, command line utilities, and logic building 💻 Web & Front-End Development • Design websites with HTML5, CSS3, and Bootstrap • Build interactive user experiences with JavaScript, jQuery, and React.js • Apply responsive design and usability principles 🗄️ Back-End & Database Development • Design and manage SQL and SQL Server databases • Execute CRUD operations with relational systems • Create back-end applications with Python (Django) and C# (.NET Framework/Core) 🧑‍💻 Programming Languages & Tools • Work with C#, Python, JavaScript, HTML, CSS, SQL, and more • Use Git, GitHub, Visual Studio, and Team Foundation Server • Learn version control and collaborative programming 🧪 Capstone Projects • Deliver two real-world projects (Python + C#) • Apply Agile, Scrum, and DevOps methods • Gain debugging, teamwork, and problem-solving skills 🧰 Career Preparation • Resume writing, cover letter strategies, and job search tips • Whiteboarding and technical interview practice • Prepare for entry-level developer opportunities 🚀 No tech background needed. Open to remote learners. 👉 Apply now: https://softwaredevpros.online/
2817 Chickasaw St, New Orleans, LA 70126, USA
$30/hour
Craigslist
Entry Level Source Testers Needed (hayward / castro valley)
We are a nationally recognized. West Coast Specialty Source (Stack) Testing firm looking for a few exceptional people to fill part time positions out of our Hayward, California office. Projects will include training. Mechanical ability, ambition and being a fast, efficient learner could potentially lead to a permanent role. We operate on the entire West Coast but are specifically looking for personnel local to our office willing to commute, learn and be a solid part of our team. Stack testing is a very sought after trade. And if you push to prove yourself, I can guarantee you a position almost anywhere in the country after putting in your time and effort with me. What is stack testing anyway? Stack testing represents an analytical procedure to measure air pollutants emitted to the atmosphere or in regulatory terms: measuring the emissions from an emission point. There are different methods to analyze the emissions from a stack. EPA has published numerous technical methods for stack testing. These highly detailed methods coupled with analytical and sampling hardware and specifically trained stack testing specialists can produce quality emission information. When is a stack test required? The most common reasons for conducting a stack test include: • Satisfying regulatory compliance requirements • Developing site specific or categorical emission factors • Engineering development, and • Guarantee verification The position will start as Part time, up to 30 hours a week and include training, mentorship and instruction on sites. The ideal candidates are technically minded, team players with understanding of mechanics, working at height, safety and most importantly, integrity. If you are seeking an entry level environmental technician job that could turn into more. We are the path, join us.
24176 Clarendale St, Hayward, CA 94544, USA
$20-25/hour
Workable
Software Engineer, Skill Level 0
At Avalore, we are a mission-driven, veteran-owned small business that helps government agencies harness the power of data and emerging technologies to solve complex problems. Our team combines deep technical expertise with a passion for public service, delivering innovative, responsible solutions in AI, data governance, cybersecurity, and enterprise transformation. Joining Avalore means working alongside experts who have successfully led high-impact initiatives across the DoD and Intelligence Community, and being part of a company that values integrity, agility, and purpose. Your responsibilities will include: Develops, maintains, and enhances complex and diverse software systems (e.g., processing-intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, and business management information systems) based upon documented requirements.  Analyze user requirements to derive software design and performance requirements  Design and code new software or modify existing software to add new features  Debug existing software and correct defects  Integrate existing software into new or modified systems or operating environments  Develop simple to complex data queries for existing or proposed databases or data repositories  Provide recommendations for improving documentation and software development process standards  Works individually or as part of a team.  Reviews and tests software components for adherence to the design requirements and documents test results.  Utilizes software development and software design methodologies appropriate to the development environment.  Provides specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of Commercial Off-the-shelf (COTS)/Government Off-the-shelf (GOTS) in place of new development, and requirements analysis and synthesis from system level to individual software components. Requirements Bachelor’s degree in a technical discipline from an accredited college or university is required  Four (4) years of relevant SWE experience may be substituted for the degree  Ability to work independently and manage multiple priorities. TS/SCI and Special Security Accesses and Polygraph required. Applicants must be currently authorized to work in the United States on a full-time basis. Avalore will not sponsor applicants for work visas for this position. Desired: Cloud, CNO, DevOps, Data Analytics, Machine Learning & AI  Benefits Eligibility requirements apply. Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Short Term & Long Term Disability Training & Development Employee Assistance Program
Fort Meade, MD, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.