Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Freelance Software Developer (C/C++ - Rust) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Analyze and understand existing code in Python or C/C++ Migrate logic to idiomatic, safe Rust while preserving functionality Adapt or port the test suite and ensure behavioral equivalence Document migration steps and technical decisions How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with C/C++ and 1+ year of hands-on experience with Rust. You are experienced with FFI tools (bindgen, cxx) and unsafe Rust for C/C++interoperability. You bring experience testing migrated code (unit/integration/fuzz tests). You demonstrate solid understanding of systems programming (memory management, concurrency). You are skilled at refactoring legacy code and documenting migration steps. Prompt engineering experience is a strong plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Michigan, USA
$50
Craigslist
Database Technician (Palmer)
POSITION SUMMARY: The Database Technician supports Tribal participation in major infrastructure projects by overseeing database management, project coordination, and financial tracking under the supervision of the Project Manager. This role ensures accurate data integration for regulatory compliance, environmental review, and engineering assessments while maintaining financial records, procurement oversight, and logistical support. DUTIES AND RESPONSIBILITIES The successful candidate will: • Maintain GIS databases, environmental records, and regulatory documentation while ensuring the accuracy, security, and accessibility of project-related data. • Provide administrative support for final presentations and compiling and submitting reports to federal, state, and Tribal partners. • Track cultural resource impact assessments to support preservation efforts. • Work alongside the Project Manager to ensure alignment between field operations and administrative workflows. • Coordinate daily database operations with the Tribal Civil Engineer and Natural Resources Department Director. • Provide logistical support to engineering review teams, environmental monitors, and cultural resource specialists. • Assist in processing timesheets, staffing requests, and equipment mobilization as part of the Tribal team’s participation in the project. • Monitor funding allocations, ensuring Tribal participation remains cost-effective and compliant. • Prepare financial summaries and expenditure reports for leadership review. • Assist with grant administration, procurement approvals, and budget forecasting for preconstruction and construction phases. • Maintain contract agreements and financial records aligned with DOT & PF and Tribal financial requirements. • Ensure all regulatory filings, permits, and compliance documentation are properly maintained. • Assist Tribal Civil Engineer and Project Manager in reviewing engineering plans, geotechnical data, and cultural resource findings. • Contribute to weekly and bi-weekly Tribal team meetings, assisting in progress tracking and interagency coordination. JOB SPECIFICATIONS: • Ability to collect data, establish facts, define problems, and draw valid conclusions. • Provide outstanding customer service to external and internal customers. • Demonstrated proficiency with Microsoft Project, Primavera P6, GIS-based data processing, and cloud database systems for regulatory documentation. • Strong knowledge of budget forecasting, grant administration, and procurement tracking for large scale infrastructure projects. • Ability to work well and with a high degree of accuracy in a busy office environment with frequent interruptions and changing priorities. • Excellent verbal and written communication skills. • Strong technical and organizational skills. • Demonstrated ability to manage multiple projects, priorities, and relationships. • Ability to work independently and interdependently in a positive and productive manner. • Ability to make decisions and exercise good judgement. • Ability to work outdoors in various weather conditions. • Maintain confidentiality and securing sensitive information. • Willingness to learn new skills and be a team player. MINIMUM REQUIREMENTS: • Bachelor’s degree in Business Administration, Information Systems, Project Management, or related field. • Five (5) + years of experience in database management, project oversight, and financial tracking; Or any equivalent combination of experience and training which provides the required knowledge, skill, and abilities. • Ability to manage high-volume data processing and secure documentation protocols. • Must have a valid driver’s license and good driving record. • Clean state and federal background check. CONDITIONS OF EMPLOYMENT: • Knowledge and experience of Knik Tribe’s Service Area and Knik Tribe’s Programs. • Adequate understanding of all Microsoft Office Applications. • Capable of basic maintenance for general office equipment and multi-line phone systems. • Must pass a criminal background check and be free of barrier crimes. • Clean driving record. • Knowledge and application of professional and ethical conduct as guided by Knik Tribal Council Personnel Manual Section 8.1. ADDITIONAL INFORMATION: NATIVE PREFERENCE STATEMENT: Pursuant to the Indian Self-Determination and Education Assistance Act of 1975 (PL 93-638) and as further guided by Knik Tribe Native Preference Policy 6.120, Knik Tribe maintains preference in all phases of employment for Alaska Native, American Indian (AN/AI) and Native Hawaiian people, including direct lineal descendants and foster or traditionally adopted children. Also included are non-Native head of household member of Native families, which includes foster or traditionally adopted Native children. DETAILS OF EMPLOYMENT: • Location : 1800 N Laurel Dr, Palmer, AK 99645 and project site • Supervisor: Project Manager • Schedule: Monday – Friday. 8:00 a.m. – 5:00 p.m. Full-time (40 hrs/week), three-year position. • Salary: $31.41 per hour. Plus full benefits: Federal Employee Health Benefits (FEHB) medical, dental, vision, life insurance, paid leave and holidays, and retirement plan with matching contributions. To Apply: Submit Resume to: Human Resources at hr@kniktribe.org For more information or to download the job description visit www.kniktribe.org/careers
J2J7+44 Lazy Mountain, AK, USA
$31/hour
Workable
Freelance Software Developer (Python Engineer) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role We are looking for an experienced Python developer who enjoys building tools, environments, and infrastructure for working with LLM-based agents. You’ll help create sandboxes, task systems, and CI/CD pipelines to support testing and development of AI agents. You’ll also work closely with researchers and domain experts, helping them set up and use these tools effectively. Although every project is unique, you might typically: Sandboxes for running and testing AI agents safely Tools for writing tasks and test cases for agents CI/CD pipelines to run checks and evaluate agents Dev environments for experts creating these tasks Repo templates and scripts to help new contributors Interfaces for tracking task input and agent results Example Tasks How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have 5+ years of experience writing Python code. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Texas, USA
$50
Craigslist
Junior .NET Developer (Hybrid - remote/on-site at client office) (Midlothian, VA)
Full-time, salaried with benefits position for a Richmond, VA-based software development company. If you love software development, are looking for a new opportunity, want to work with some of the most talented developers in Richmond, and are passionately concerned about the quality of your work, our client is looking for you. Minimum Required Skill Sets • Three years of hands-on, on-the-job experience with .NET framework/Core either C# or VB.NET (C# preferred) • Experience with ASP. Net • Three years of on-the-job client-side experience with HTML, CSS, and JavaScript • Experience with common web application technology, including AJAX, JSON, RESTful API • Three years of hands-on, on-the-job experience with SQL Server development, including stored procedures, functions, and triggers Applicants must have at least two years of college, two years of work experience in the field, excellent oral and written communication skills, and work references in the United States. Applicants must reside in the Richmond, Virginia metro area. Applicants must be a citizen, or be authorized to work in the U.S. We do not offer sponsorship. This is a hybrid work environment. You will work at our client's site for 1 or 2 days each week, and work remotely for the other days. We cannot accommodate 100% remote work for this project, but we may be able to for future projects.
1700 Salisbury Dr, Midlothian, VA 23113, USA
$70,000-90,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.