Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
iOS Engineer (Women's Health)
Our mission at Oura is to empower every person to own their inner potential. Our award-winning products help our global community gain a deeper knowledge of their readiness, activity, and sleep quality by using their Oura Ring and its connected app. We've helped over one million people understand and improve their health by providing daily insights and practical steps to inspire healthy lifestyles. Empowering the world starts with living our values and empowering our team. As a quickly growing company focused on helping people live healthier and happier lives, we ensure that our team members have what they need to do their best work — both in and out of the office.  Our engineering organization consists of many talented Android and iOS app developers distributed across the EU and US. All app developers collaborate closely on each platform, regardless of location or specific feature squad. For day-to-day feature work, our engineers are organized into smaller cross-functional feature squads or teams. Our squads have a great deal of autonomy and are responsible for the development and architecture of their features. Squads take full ownership of their code and handle everything from concepting, design and implementation to release, maintenance and bug fixes. This is a remote US role with a preference for candidates based in the US-Pacific timezone. We have offices in San Francisco and San Diego for those who prefer hybrid or office settings. We also have employee hubs in New York City, Boston, Los Angeles, Seattle, and more. Our teams are growing and we are searching for iOS engineers at all levels (minimum 3 years of experience) to help build and maintain key features in our iOS app. You will join a team that truly cares about Oura’s mission, product, and the quality of user experience. You and your team will work together to push the boundaries of what’s possible with wearable products. What you will do:  Work together with other engineers to improve our app experience and codebase Deliver and maintain high quality code for projects on the roadmap Push our products forward by closely aligning with PMs and Designers Collaborate with other teams such as firmware, data, backend, or science to implement new features in the Oura mobile app Requirements We would love to have you on our team if you have: Minimum 3+ years of professional development experience shipping iOS apps Strong experience with Swift, modern iOS app architectures, and common third-party libraries and frameworks Experience with collaborative development on complex shared codebases Proficiency with git, branching, and standard code review workflows Focus on quality through unit tests and manual testing Computer science fundamentals and design patterns We also appreciate if you have: 5+ years of professional development experience shipping iOS apps Any of the following: Swift structured concurrency, Combine, SQLite/GRDB, UIKit, SwiftUI, CoreAnimation, CoreGraphics, C++, PyTorch, ML algorithms, TypeScript, CI/CD, or Kotlin Multiplatform Ability to take ownership of projects and design technical solutions Experience with Agile or Scrum processes Experience with systems architecture and performance optimization Experience working asynchronously across countries and time zones Experience working with firmware teams on projects involving hardware Experience developing health, wellness, fitness, or women’s health products Experience with ML algorithms, encryption, or data privacy Experience with functional programming Benefits At Oura, we care about you and your well-being. Everyone here at Oura has a ring of their own and we are continually looking to improve employee health. What we offer: Competitive salary and equity packages Health, dental, vision insurance, and mental health resources An Oura Ring of your own plus employee discounts for friends & family 20 days of paid time off plus 13 paid holidays plus 8 days of flexible wellness time off Paid sick leave and parental leave Oura takes a market-based approach to pay, which may vary depending on your location. US locations are categorized into tiers based on a cost of labor index for that geographic area. While most offers will be closer to the starting range, successful candidates' pay will be determined based on job-related skills, experience, qualifications, work location, internal peer equity, and market conditions. These ranges may be modified in the future. Region 1 $142,000- $178,000  Region 2 $130,000- $163,000  Region 3 $120,000- $150,000 A recruiter can determine your zones/tiers based on your US location. We are not considering candidates residing in the following states: Alaska (AK), Delaware (DE), Iowa (IA), Mississippi (MS), Missouri (MO), Nebraska (NE), Oklahoma (OK), Rhode Island (RI), South Dakota (SD), Vermont (VT), West Virginia (WV), and Wisconsin (WI) Oura is proud to be an equal opportunity workplace. We celebrate diversity and are committed to creating an inclusive environment for all employees. Individuals seeking employment at Oura are considered without regard to age, ancestry, color, gender (including pregnancy, childbirth, or related medical conditions), gender identity or expression, genetic information, marital status, medical condition, mental or physical disability, national origin, protected family care or medical leave status, race, religion (including beliefs and practices or the absence thereof), sexual orientation, military or veteran status, or any other characteristic protected by federal, state, or local laws. We will not tolerate discrimination or harassment based on any of these characteristics. We will work to ensure individuals with disabilities are provided reasonable accommodation to participate in the interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Disclaimer: Beware of fake job offers! We’ve been alerted to scammers posing as ŌURA recruiters, especially for remote roles. Please note: Our jobs are listed only on the ŌURA Careers page and trusted job boards. We will never ask for personal information like ID or payment for equipment upfront. Official offers are sent through Docusign after a verbal offer, not via text or email. Stay cautious and protect your personal details. To all recruitment agencies: Oura does not accept agency resumes. Please do not forward resumes to our jobs alias, Oura employees, or any other organization's location. Oura is not responsible for any fees related to unsolicited resumes.
San Francisco, CA, USA
$120,000-178,000/year
Workable
Software Engineer, Skill Level 0
At Avalore, we are a mission-driven, veteran-owned small business that helps government agencies harness the power of data and emerging technologies to solve complex problems. Our team combines deep technical expertise with a passion for public service, delivering innovative, responsible solutions in AI, data governance, cybersecurity, and enterprise transformation. Joining Avalore means working alongside experts who have successfully led high-impact initiatives across the DoD and Intelligence Community, and being part of a company that values integrity, agility, and purpose. Your responsibilities will include: Develops, maintains, and enhances complex and diverse software systems (e.g., processing-intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, and business management information systems) based upon documented requirements.  Analyze user requirements to derive software design and performance requirements  Design and code new software or modify existing software to add new features  Debug existing software and correct defects  Integrate existing software into new or modified systems or operating environments  Develop simple to complex data queries for existing or proposed databases or data repositories  Provide recommendations for improving documentation and software development process standards  Works individually or as part of a team.  Reviews and tests software components for adherence to the design requirements and documents test results.  Utilizes software development and software design methodologies appropriate to the development environment.  Provides specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of Commercial Off-the-shelf (COTS)/Government Off-the-shelf (GOTS) in place of new development, and requirements analysis and synthesis from system level to individual software components. Requirements Bachelor’s degree in a technical discipline from an accredited college or university is required  Four (4) years of relevant SWE experience may be substituted for the degree  Ability to work independently and manage multiple priorities. TS/SCI and Special Security Accesses and Polygraph required. Applicants must be currently authorized to work in the United States on a full-time basis. Avalore will not sponsor applicants for work visas for this position. Desired: Cloud, CNO, DevOps, Data Analytics, Machine Learning & AI  Benefits Eligibility requirements apply. Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Short Term & Long Term Disability Training & Development Employee Assistance Program
Fort Meade, MD, USA
Negotiable Salary
Workable
Senior Numerical Algorithm Software Engineer
SciTec has been awarded multiple government contracts and is growing our creative Team! SciTec, Inc. is a dynamic small business with the mission to deliver advanced sensor data processing technologies and scientific instrumentation capabilities in support of National Security and Defense. We support customers throughout the Department of Defense and U.S. Government in building innovative new tools to deliver unique world-class data exploitation capabilities. Important Notice: SciTec exclusively works on U.S. government contracts that require U.S. citizenship for all employees. SciTec cannot sponsor or assume sponsorship of employee work visas of any type. Further, U.S. citizenship is a requirement to obtain and keep a security clearance. Applicants that do not meet these requirements will not be considered. SciTec has immediate opportunities for talented software & algorithm developers and engineers to support programs focusing on low-latency data processing, fusion, and tracking algorithms for exploitation of remote sensing systems. Our ideal candidate will work well in multiple software languages as part of a rapid pace, collaborative, small-team environment consisting of Scientists, Engineers, and Developers and be able to prototype and develop advanced algorithms leading to eventual integration in C++ on Linux operating systems as part of government frameworks. Responsibilities Research new algorithms and analysis techniques for remote sensor data exploitation Demonstrate fluent, idiomatic mastery of Python and C++; comfortable with software design and architecture Develop proof-of-concept signal processing, image processing, and data exploitation tools in Python Improve Python tools surrounding our machine learning, modeling, and simulation efforts Characterize quality/performance of algorithms and sensor systems Work as part of an Agile team and contribute to shared tools Other duties as assigned Requirements A Bachelor's degree in the physical sciences, mathematics, engineering, or computer science. At least five years ongoing professional experience and fluency in the following languages: C++, Python At least five years ongoing professional experience using Linux operating systems (additional years of education may be substituted for years of experience) Professional experience with the exploitation and analysis of OPIR, E/O, SAR, Spectral, RF, or other remotely sensed data Ability to work full-time in-person in Boulder, CO office location Detail oriented Good verbal and written communication skills Candidates who have any of the following skills will be preferred A current active DoD SECRET security clearance or higher An advanced degree in the physical sciences, mathematics, engineering, or computer science Professional experience with application orchestration and/or deployment to the cloud Professional experience with Agile software development *Resumes, Cover Letters, and Applications which are generated by AI will not be considered for employment Colorado Residents: In any materials you submit, you may redact or remove age-identifying information such as age, date of birth, or dates of school attendance or graduation. You will not be penalized for redacting or removing this information. Benefits SciTec offers a highly competitive salary and benefits package, including: Employee Stock Ownership Plan (ESOP) 3% Fully Vested Company 401K Contribution (no employee contribution required) 100% company paid HSA Medical insurance, with a choice of 2 buy-up options 80% company paid Dental insurance 100% company paid Vision insurance 100% company paid Life insurance 100% company paid Long-term Disability insurance 100% company paid Hospital Indemnity insurance Voluntary Accident and Critical Illness insurance Short-term Disability insurance Annual Profit-Sharing Plan Discretionary Performance Bonus Paid Parental Leave Generous Paid Time Off, including Holiday, Vacation, and Sick Pay Flexible Work Hours The pay range for this position is $117,000 - $168,000 / year. SciTec considers several factors when extending an offer of employment, including but not limited to the role and associated responsibilities, a candidate's work experience, education/training, and key skills. This is not a guarantee of compensation. SciTec is proud to be an Equal Opportunity employer. VETS/Disabled. #ND123
Boulder, CO, USA
$117,000-168,000/year
Workable
Angular Developer Designer
Description: Role Name: Angular Developer / Designer Location: US-NYC / FIFTHAVE / Hybrid - New York, NY Who We’re Looking For: We seek self-starters who thrive in fast-paced environments and tackle challenges with intellectual curiosity and a proactive mindset. Candidates must be adaptable, collaborative, and accountable, consistently delivering top-quality results while acting with integrity. Job Functions / Duties & Responsibilities Front-End Design & Development Design and develop front-end applications using Angular 9+, RxJS, TypeScript, HTML, CSS, and JavaScript Deliver impactful UI components that shape user experiences Requirements & Stakeholder Engagement Work with senior technology and business stakeholders to gather requirements and guide design decisions Implement features for complex workflows, including validation, approvals, and dashboards Innovation & Problem-Solving Develop innovative solutions to meet business needs, enhancing enterprise applications with middleware or custom RESTful services Agile & DevOps Collaboration Participate in Agile ceremonies; contribute to CI/CD pipelines for automated builds and deployments Engage in all SDLC phases—analysis, design, coding, testing, and implementation Quality Assurance & Support Apply DevOps practices to maintain code quality and reliability Proactively identify and resolve front-end issues, offering production support when needed Required Skills Angular Expertise 7–10 years of front-end development using Angular 9+ (ReactJS as a bonus), RxJS, and TypeScript Front-End Proficiency Skilled in JavaScript, HTML, CSS, AJAX, and responsive design Integration & Web Services Experience with SOAP/REST/SSL and enterprise data flows SDLC & Agile Methodologies Proficiency in Agile frameworks (Scrum/Kanban), DevOps (CI/CD), and tools like JIRA Teamwork & Communication Excellent communication and presentation skills; comfortable collaborating with diverse teams in a fast-paced environment
New York, NY, USA
Negotiable Salary
Workable
Senior Data Engineer
PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financial ecosystem. We are a boutique firm, where each person’s contributions and ideas are critical to the growth of the company.  This is a fully remote position, open to candidates anywhere in the U.S. with a reliable internet connection. While we gather in person a few times a year, this role is designed to remain remote long-term. You will have autonomy and flexibility in a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action. You'll collaborate with a high-performing team — including sales, marketers, and financial services experts —  who stay connected through Slack, video calls, and regular team and company-wide meetings. We’re a team that knows how to work hard, have fun, and make a meaningful impact—both together and individually. Job Summary We are seeking a Senior Data Engineer to lead the design and implementation of scalable data pipelines that ingest and process data from a variety of external client systems. This role is critical in building the data infrastructure that powers Plum’s next-generation AI-driven products. You will work with a modern data stack including Python, Databricks, AWS, Delta Lake, and more. As a senior member of the team, you’ll take ownership of architectural decisions, system design, and production readiness—working with team members to ensure data is reliable, accessible, and impactful. Key Responsibilities Design and architect end-to-end data processing pipelines: ingestion, transformation, and delivery to the Delta Lakehouse. Integrate with external systems (e.g., CRMs, file systems, APIs) to automate ingestion of diverse data sources. Develop robust data workflows using Python and Databricks Workflows. Implement modular, maintainable ETL processes following SDLC best practices and Git-based version control. Contribute to the evolution of our Lakehouse architecture to support downstream analytics and machine learning use cases. Monitor, troubleshoot, and optimize data workflows in production. Collaborate with cross-functional teams to translate data needs into scalable solutions. Requirements Master’s degree in Computer Science, Engineering, Physics, or a related technical field or equivalent work experience. 3+ years of experience building and maintaining production-grade data pipelines. Proven expertise in Python and SQL for data engineering tasks. Strong understanding of lakehouse architecture and data modeling concepts. Experience working with Databricks, Delta Lake, and Apache Spark. Hands-on experience with AWS cloud infrastructure. Track record of integrating data from external systems, APIs, and databases. Strong problem-solving skills and ability to lead through ambiguity. Excellent communication and documentation habits. Preferred Qualifications Experience building data solutions in Fintech, Sales Tech, or Marketing Tech domains. Familiarity with CRM platforms (e.g., Salesforce, HubSpot) and CRM data models. Experience using ETL tools such as Fivetran or Airbyte. Understanding of data governance, security, and compliance best practices. Benefits A fast-paced, collaborative startup culture with high visibility. Autonomy, flexibility, and a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action.  Opportunity to make a meaningful impact in building a company and culture.  Equity in a financial technology startup.  Generous health, dental, and vision coverage for employees and family members + 401K. Eleven paid holidays and unlimited discretionary vacation days. Competitive compensation and bonus potential.
San Francisco, CA, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.