Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Data Engineer III
Position: Data Engineer III    Location: Redmond, WA 98052    Duration: 12 Months       Job Type: Contract         Work Type:  Onsite      Job Description:     Responsibilities  Build statistical models to identify patterns and trends in production testing data (telemetry, time-series) to generate correlation and predictions.  Develop an understanding of the manufacturing execution system with its multiple sources of data and relationship. Analyze the production system data and derive insights into current bottlenecks and areas of improvement, along with specific actionable recommendations  Collect, format and report periodic snapshots of the production and test data for consumption by other program managers and engineers.  Synthesize analysis and communicate insights and recommendations to various audiences  Work closely with technical program managers and engineers to provide data insights that help explain anecdotes from the manufacturing floor, and provide actionable resolution steps  Create templates and scripts to help scale and automate our ability to ingest, analyze and enable quick data reviews.  Required Skills & Experience  7+ years of related experience (data science, data engineering, data analysis, ML engineering)  4+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, Minitab, etc.) experience  2+ years of machine learning/statistical modeling data analysis tools and techniques, and parameters that affect their performance experience  Very Strong development experience with notable BI reporting tools (Oracle BI Enterprise Edition (OBIEE)).  Should have experience developing complex and a variety of reports.  A good candidate has strong analytical skills and enjoys working with large complex data sets.  Experience applying theoretical models in an applied environment  A good candidate can partner with business owners directly to understand their requirements and provide data which can help them observe patterns and spot anomalies. Preferred  Experience in Python, Perl, or another scripting language  Master's degree in a quantitative field such as statistics, mathematics, data science, engineering, or computer science  Experience in aerospace, manufacturing, test processes and/or test systems development  Typical Day in the Role:    Daily Schedule:   Accelerate test data collection and reviews to help reduce testing requirements across the OISL LRUs  Simplify and automate (with scripts and standard schemas) the continuous collection and formatting of such data  Develop dashboards and visualizations to help the test triage process  Develop a continuous monitoring and alarming framework that can help inform Engineers of areas needing a deeper analysis  Partner with the continuous improvement and OISL teams to accelerate the creation of analysis and tooling to establish manufacturing statistical process controls of key LRUs and test processes  Candidate Requirements:    REQUIRED SKILLS  Years of Experience: 5 years  Leadership Principle:   Customer Obsession, Learn and Be Curious, Dive Deep, Clear communication  Top 3 must-have hard skills  5+ years of related experience (data science, data engineering, data analysis, ML engineering)  scripting languages (e.g. Python  Statistical modeling data analysis tools   
Redmond, WA, USA
Negotiable Salary
Craigslist
Business Analyst - Full Time / Full Benefits (Factoria)
Business Analyst w/ a focus on: cyber detective job focused on SMS security Overview: The primary day to day role of this backfill will be reviewing commercial SMS traffic using various databases and web portals as well as running Splunk queries in order to identify phishing, Social Engineering, or other illegal/disallowed content. Key Responsibilities: Review commercial SMS traffic using internal databases and web portals. Execute and analyze Splunk queries to detect suspicious or prohibited content. Identify phishing, social engineering, and other malicious messaging patterns. Adhere to internal guides and industry standards Maintain detailed documentation and tracking reports for investigations. Handle confidential content with discretion and professionalism. Required Skills & Qualifications: Strong aptitude for reviewing large datasets with high attention to detail. Solid understanding of phishing and social engineering tactics. Experience with database querying tools (preferably Splunk). Thorough and cautious approach to investigations, with an understanding of the potential impact of errors in a production environment. Proven ability to maintain accurate and comprehensive documentation. Familiarity with Shortcode, 10DLC, and Toll-Free number systems. Preferred Qualifications: Prior experience working on confidential or sensitive projects. Exposure to dark projects or environments involving secure content review.
7540 Leary Wy, Redmond, WA 98052, USA
$40/hour
Workable
Freelance Software Developer (C/C++ - Rust) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Analyze and understand existing code in Python or C/C++ Migrate logic to idiomatic, safe Rust while preserving functionality Adapt or port the test suite and ensure behavioral equivalence Document migration steps and technical decisions How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with C/C++ and 1+ year of hands-on experience with Rust. You are experienced with FFI tools (bindgen, cxx) and unsafe Rust for C/C++interoperability. You bring experience testing migrated code (unit/integration/fuzz tests). You demonstrate solid understanding of systems programming (memory management, concurrency). You are skilled at refactoring legacy code and documenting migration steps. Prompt engineering experience is a strong plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Michigan, USA
$50
Craigslist
Tech Support Representative (Andersonville, Chicago)
Booklog is looking for a level 1 – 3 technical support individual. This position is to provide outstanding technical support for Booklog software and various interfaces along with onboarding of new customers, testing of software and training on usage of software. We’re looking for a motivated individual to be part of our committed team. We need to be the experts so our customers don’t have to. Located in Chicago’s Andersonville neighborhood; telecommuting is available. Qualifications • At least 2 years experience in technical support, preferably phone support • Experience with Microsoft Windows operating systems • Familiarity with databases and database troubleshooting • Knowledge of computer network systems • Ability to troubleshoot software problems and offer solutions by phone • Good problem solving skills with attention to detail • Strong verbal, written, interpersonal, and organizational skills • Ability to work both independently and in a team environment • Experience with SQL Server 2022, Sybase SQL applications and databases • Ability and excitement to learn new skills • A ‘think outside of the box’ mentality • Customer Service experience • Software training experience a plus • Previous experience training customers on software usage • Experience with use of peripheral devices • 10% or less travel to customer locations within the US to train and install software Benefits • Casual environment with a great group of people who love what they do • In office or telecommuting options • 100% paid health insurance • 2 weeks vacation to start • Generous 401K options • Permanent full-time. PLEASE SEND RESUME WHEN APPLYING
5146 N Clark St #1222, Chicago, IL 60640, USA
$50,000/year
Workable
Freelance Software Developer (Python Engineer) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role We are looking for an experienced Python developer who enjoys building tools, environments, and infrastructure for working with LLM-based agents. You’ll help create sandboxes, task systems, and CI/CD pipelines to support testing and development of AI agents. You’ll also work closely with researchers and domain experts, helping them set up and use these tools effectively. Although every project is unique, you might typically: Sandboxes for running and testing AI agents safely Tools for writing tasks and test cases for agents CI/CD pipelines to run checks and evaluate agents Dev environments for experts creating these tasks Repo templates and scripts to help new contributors Interfaces for tracking task input and agent results Example Tasks How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have 5+ years of experience writing Python code. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Texas, USA
$50
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.