Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Craigslist
* NOW HIRING * Free Phone Sales Agents & Teams
Company Website: https://alphatechnologiesllc.org/ Free Phone Program: Alpha Technologies is NOW HIRING hard working, self-directed customer service agents who can work in a fast-paced environment as an OUTDOOR lifeline customer service agent. Agents will distribute free federal lifeline program devices to qualified applicants based on each program’s unique qualifications. Sales skills are not required to apply, but we are looking for people with great personalities and go-getter attitudes! We have a friendly work environment, flexible scheduling, and we are looking for someone who can work hard, smash their goals, and fit into our company. Compensation: $15-$55/per depending upon experience, service area, and potential team size. Competitive rates for the industry. Paid weekly by direct deposit. Specific rates are discussed after a short interview is conducted and your skills are assessed. Position Benefits: Competitive and Dynamic Pay rates Management & Business Opportunities Timely weekly direct deposit payouts No caps on sales Expansion opportunities Full support from administrative staff and team Transparent Reporting Applicant Requirements: 1. Must be 18+ with a valid US State Identification or Driver’s License. 2. Must have RELIABLE transportation to get to and from work, and change locations as needed. 3. Must be able to work at least three to five days a week. 4. Must be self-motivated, punctual, and an effective communicator. 5. Must be able to work in a professional environment and be professional yourself. 6. Must have a data capable TABLET to process orders (Android or Apple depends on the program) 7. Must be intelligent, self-starting, and self-managing 8. Must be non-judgmental, unbiased, and tolerant of all walks of life. 9. Must be able to work outside in different types of weather (not extreme weather conditions). 10. Must take this position seriously Agents/Managers: If interested in being part of the team, please follow the link to review the position. Once satisfied, click the Become an Agent link and carefully fill out all fields. Someone from our team will reach out to you within a few hours. Website: https://alphatechnologiesllc.org/careers ISO’s/Business Owners/LLCs: If interested in partnering with us, please follow the link and click Become a Partner under the ‘Apply With Us’ section to fill out a detailed message about your organization. Someone from our team will reach out to you within a few hours. MUST HAVE AT LEAST 4 AGENTS before launch and an ACTIVE LLC to be considered. Otherwise, please choose the option above and you will be placed as a team leader under a different organization. Website: https://alphatechnologiesllc.org/careers
3637 Pinell St, Sacramento, CA 95838, USA
$15-55/hour
Workable
Principal Software Engineer- React Native
A Principal Software Engineer for React Native is an associate at Creative Chaos who is mainly responsible for developing front-end mobile client applications for various software platforms. A Principal Software Engineer makes sure that the functionality, security, and performance of the server application are as per the design and are completely bug-free. Principal engineers have a responsibility to lead a team of engineers and mentor team members through continuous training and guidance. Job Description: Analyze business requirements Estimate assigned tasks Write code and unit tests Collaborate with other team members Tune your code for enhanced security and performance Maintain systems by fixing any existing issues Update issue tracking software Provide status updates Communicate with client Control versions of your code Research new technologies Lead a team of software engineers Mentor team members through training and guidance Upgrade skills and knowledge Evaluate candidates for open positions Requirements Minimum Bachelors in Computer Science/Software Engineering or equivalent. Minimum 6-10 years of related experience in a professional industry Highly proficient in rendering components with Native APIs. Transitioned from native IOS / Android (Objective C) to React Native. Good Hands-on with Typescript and GraphQL database. Understanding of REST APIs, the document request model, and offline storage Experience working with Swift, Kotlin, Objective C, or Java is a plus. Proficient in CSS, HTML, and writing cross-platform compatible code. Excellent programming and analytical skills with knowledge of design patterns Knowledge of and experience with Github, JIRA, and other collaboration tools Excellent verbal and written English communication skills Flexible attitude and versatile personality Strong presentation skills Strong influence among team members Benefits Paid Time Off Work From Home Health Insurance OPD Training and Development Life Insurance Exchange Program
Islamabad, Pakistan
Negotiable Salary
Workable
.NET Core Developer - DMV Systems
The ITD Department of Motor Vehicles (DMV) needs a strong .NET core/C# software engineer. This is a FULLY ONSITE POSITION located in Boise, Idaho. Remote work WILL NOT be considered. Experience: 6 Years IMPORTANT:  This is a FULLY ONSITE POSITION located in Boise, Idaho. Remote work WILL NOT be considered. Local candidates should be submitted for the position.  The ITD Department of Motor Vehicles (DMV) has the obligation to provide a variety of motor vehicle registration services, operator licensing services, and regulatory compliance services as mandated by the Idaho Legislature and applicable Federal regulations. DMV is modernizing their systems and is developing and maintaining a significant baseline of source code and associated data base structures as a part of this modernization effort. Session management in .Net Core web development will be a big part of the job. The scope of this work is to develop software systems for: 1. Driver's License Issuance and Credentialing 2. Vehicle Registration and Titling 3. Motor Vehicle regulation compliance 4. Commercial Motor Vehicle Services 5. Motor Vehicle Dealer licensing 6. Supporting Administrative Systems 7. Other features and functions as designated by the Motor Vehicle Administrator Agency Expected Deliverables 1. Reviewing, understanding and implementing defined customer requirements. 2. Reviewing, understanding and correcting identified problems. 3. Testing and verification of operation consistent with user requirements. 4. Source Code meeting ITD quality standards and in conformance with established procedures. 5. Release of object code meeting ITD quality standards and in conformance with established procedures. 6. Interacting with technical and non-technical staff as needed in the execution of the above in an Agile/Scrum environment
Boise, ID, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.