Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Freelance Software Developer (C/C++ - Rust) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Analyze and understand existing code in Python or C/C++ Migrate logic to idiomatic, safe Rust while preserving functionality Adapt or port the test suite and ensure behavioral equivalence Document migration steps and technical decisions How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with C/C++ and 1+ year of hands-on experience with Rust. You are experienced with FFI tools (bindgen, cxx) and unsafe Rust for C/C++interoperability. You bring experience testing migrated code (unit/integration/fuzz tests). You demonstrate solid understanding of systems programming (memory management, concurrency). You are skilled at refactoring legacy code and documenting migration steps. Prompt engineering experience is a strong plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Michigan, USA
$50
Craigslist
Data Acquisition Lead (menlo park)
About Us Domalytx is reimagining the future of home inspections by combining deep field expertise with cutting-edge technology. Founded and built by civil engineers with over 15 years and 5,000+ inspections under their belt, we know the real problems inspectors face and the level of accuracy homeowners and buyers demand. Headquartered in Silicon Valley, we bring a technology-first mindset to an industry that has long lagged behind in innovation. Our platform transforms inspections from a slow, manual process into a streamlined, AI-assisted experience where inspectors can simply walk, talk, and capture photos while the software generates clear, professional reports. Backed by our leadership in foundation, structural, seismic, and drainage inspections—the most complex and high-stakes areas in residential real estate—we are uniquely positioned to become the trusted standard for property condition reporting nationwide. Joining Domalytx means being part of a team that’s not just modernizing inspections, but building the platform that will define how homes are evaluated, bought, and maintained for decades to come. The Role We’re looking for an Industry Partnerships & Data Acquisition Lead to help us grow the network of professionals contributing to our platform. You won’t do this alone. You’ll be partnered with an industry veteran (engineer/inspector) who can jump in for credibility, sit in on Zoom calls, or join in-person meetings when technical authority is needed. You’ll drive the outreach and relationship-building; they’ll provide subject matter expertise when needed. This isn’t a traditional sales or data role. It’s part relationship-building, part process design, and part entrepreneurial hustle. You’ll be helping invent a new category. What You’ll Do • Focus on building trust to foster participation from our leads • Oversee the process of capturing and structuring data. • Partner with our industry expert for select calls and meetings to deepen credibility. • Document and improve our strategies for relationship building. • Track progress and report on what’s working and where to adjust. What We’re Looking For • Proven success in sales, partnerships, business development, or community engagement (bonus if with contractors, SMBs, or real estate pros). • Natural relationship-builder with strong communication skills. • High resilience — able to handle pushback and keep going. • Process-oriented: can turn messy lessons learned into repeatable systems. • Comfortable with CRM tools, spreadsheets, and documenting workflows. • Curious and adaptable — able to learn the basics of industry language quickly. • Entrepreneurial mindset: thrives in ambiguity and likes building from scratch. What We Offer • The chance to pioneer a role in a massive, untapped industry. • Direct mentorship from founders and collaboration with industry experts. • An industry partner at your side for credibility and support. • Competitive compensation with upside as we grow. • Remote flexibility, with occasional in-person visits depending on geography. • A mission-driven company improving how millions of homeowners make decisions. Why Join Now? No one in this industry has done this before. You won’t be plugging into a machine — you’ll help design it. If you want to be the first of your kind in a growing startup, and if you’ve got the hustle and curiosity to make it work, we’d love to hear from you. How to Apply Send us your LinkedIn profile, resume, a note about why this role excites you and share an example of a time when you had to hustle to convince someone or build a relationship from scratch. Thanks!
88 Isabella Ave, Atherton, CA 94027, USA
Negotiable Salary
Workable
Senior Numerical Algorithm Software Engineer
SciTec has been awarded multiple government contracts and is growing our creative Team! SciTec, Inc. is a dynamic small business with the mission to deliver advanced sensor data processing technologies and scientific instrumentation capabilities in support of National Security and Defense. We support customers throughout the Department of Defense and U.S. Government in building innovative new tools to deliver unique world-class data exploitation capabilities. Important Notice: SciTec exclusively works on U.S. government contracts that require U.S. citizenship for all employees. SciTec cannot sponsor or assume sponsorship of employee work visas of any type. Further, U.S. citizenship is a requirement to obtain and keep a security clearance. Applicants that do not meet these requirements will not be considered. SciTec has immediate opportunities for talented software & algorithm developers and engineers to support programs focusing on low-latency data processing, fusion, and tracking algorithms for exploitation of remote sensing systems. Our ideal candidate will work well in multiple software languages as part of a rapid pace, collaborative, small-team environment consisting of Scientists, Engineers, and Developers and be able to prototype and develop advanced algorithms leading to eventual integration in C++ on Linux operating systems as part of government frameworks. Responsibilities Research new algorithms and analysis techniques for remote sensor data exploitation Demonstrate fluent, idiomatic mastery of Python and C++; comfortable with software design and architecture Develop proof-of-concept signal processing, image processing, and data exploitation tools in Python Improve Python tools surrounding our machine learning, modeling, and simulation efforts Characterize quality/performance of algorithms and sensor systems Work as part of an Agile team and contribute to shared tools Other duties as assigned Requirements A Bachelor's degree in the physical sciences, mathematics, engineering, or computer science. At least five years ongoing professional experience and fluency in the following languages: C++, Python At least five years ongoing professional experience using Linux operating systems (additional years of education may be substituted for years of experience) Professional experience with the exploitation and analysis of OPIR, E/O, SAR, Spectral, RF, or other remotely sensed data Ability to work full-time in-person in Boulder, CO office location Detail oriented Good verbal and written communication skills Candidates who have any of the following skills will be preferred A current active DoD SECRET security clearance or higher An advanced degree in the physical sciences, mathematics, engineering, or computer science Professional experience with application orchestration and/or deployment to the cloud Professional experience with Agile software development *Resumes, Cover Letters, and Applications which are generated by AI will not be considered for employment Colorado Residents: In any materials you submit, you may redact or remove age-identifying information such as age, date of birth, or dates of school attendance or graduation. You will not be penalized for redacting or removing this information. Benefits SciTec offers a highly competitive salary and benefits package, including: Employee Stock Ownership Plan (ESOP) 3% Fully Vested Company 401K Contribution (no employee contribution required) 100% company paid HSA Medical insurance, with a choice of 2 buy-up options 80% company paid Dental insurance 100% company paid Vision insurance 100% company paid Life insurance 100% company paid Long-term Disability insurance 100% company paid Hospital Indemnity insurance Voluntary Accident and Critical Illness insurance Short-term Disability insurance Annual Profit-Sharing Plan Discretionary Performance Bonus Paid Parental Leave Generous Paid Time Off, including Holiday, Vacation, and Sick Pay Flexible Work Hours The pay range for this position is $117,000 - $168,000 / year. SciTec considers several factors when extending an offer of employment, including but not limited to the role and associated responsibilities, a candidate's work experience, education/training, and key skills. This is not a guarantee of compensation. SciTec is proud to be an Equal Opportunity employer. VETS/Disabled. #ND123
Boulder, CO, USA
$117,000-168,000/year
Craigslist
Build Your Career in Software Development 🧑‍💻
We are inviting motivated individuals who want to grow into careers in technology. If you want to learn coding, complete projects, and prepare for entry-level developer roles, this training path is for you. This is a remote program available part-time or full-time. With nearly 900 hours of guided lessons and project work, you’ll master modern languages, developer tools, and workflows—all while building a résumé and portfolio that will impress employers. 🖥️ Technology & Programming Fundamentals -Understand how computers, browsers, networks, and the internet operate -Study algorithms, number systems, data structures, and security basics -Practice Python scripting, command line operations, and logic design 💻 Web & Front-End Development -Develop websites with HTML5, CSS3, and Bootstrap -Build dynamic web content using JavaScript, jQuery, and React.js -Practice responsive design techniques and layout principles 🗄️ Back-End & Database Development -Design and maintain databases with SQL and SQL Server -Perform CRUD tasks and explore relational models -Build back-end systems using Python (Django) and C# (.NET Framework/Core) 🧑‍💻 Programming Languages & Tools -Learn C#, Python, JavaScript, HTML, CSS, SQL, and other languages -Use Git, GitHub, Visual Studio, and Team Foundation Server -Apply collaboration methods and version control systems 🧪 Capstone Projects -Complete two professional projects (Python + C#) -Build portfolio-ready applications with Agile, Scrum, and DevOps -Strengthen debugging, teamwork, and coding abilities 🧰 Career Preparation -Write résumés and cover letters tailored to tech careers -Practice technical and whiteboard interview preparation -Get ready for entry-level developer jobs 🚀 No experience necessary. Remote opportunities available. Take the next step in your professional journey. 👉 Apply now: https://softwaredevpros.online/
4844 Highlander Cove, Antioch, TN 37013, USA
$30/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.