Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Freelance Software Developer (Python-Rust) - AI Trainer
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically: Analyze and understand existing code in Python or C/C++ Migrate logic to idiomatic, safe Rust while preserving functionality Adapt or port the test suite and ensure behavioral equivalence Document migration steps and technical decisions How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with Python, 1+ year of Rust (or fast learning capability). Your level of English is advanced (C1) or above. Experience with PyO3/maturin for Python-Rust interoperability. Knowledge of Docker, Kubernetes, and CI/CD for hybrid Python-Rust apps. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Michigan, USA
$50
Workable
Senior Software Engineer
Commify is on a mission to revolutionize business communications, and we are looking for an experienced Senior Software Engineer to join our passionate team. In this role, you will lead the development and enhancement of our cutting-edge messaging platform, ensuring it meets the evolving needs of businesses around the world. Your expertise will help shape our product vision, drive innovation, and create exceptional user experiences. As a Senior Software Engineer, you will collaborate closely with product managers, designers, and fellow engineers to deliver high-quality software solutions. We value creativity, critical thinking, and a proactive approach to problem-solving. If you have a strong technical background and want to work in a fast-paced environment, Commify is the perfect place for you. Requirements The Senior Software Engineer will:: Architect, design, develop, and deploy software solutions across our products. Engage in all phases of the software development lifecycle in an agile environment. Collaborate with cross functional teams to refine requirements into actionable tasks. Contribute to continuous improvement initiatives within the engineering team. Mentor junior developers and support overall team growth and learning. Drive adherence to best practices and coding standards. Ideal candidates will possess: Extensive experience in software development with modern programming languages. Strong foundation in C# .NET/.NET Core and Angular. Experience running production systems at scale in Microsoft Azure. Experience with CI/CD pipelines, Dev/Ops methodologies, and test automation. Experience with containerization technologies, such as Docker and Kubernetes Proven experience designing and building REST APIs. Experience with version control systems, especially GitHub. Understanding of agile methodologies and practices. Exposure to micro-SPA frontend application architecture. Excellent problem solving skills and attention to detail. Team oriented mindset with strong communication abilities. Ability to manage multiple priorities and meet deadlines. Preferred Qualifications: Experience in building and scaling multi-channel CPaaS/messaging platforms (SMS, MMS, RCS, WhatsApp, Voice, and Email). Experience working in a diverse, international team. Benefits Competitive Salary ($120,000 - 135,000) Company Bonus Enjoy the flexibility of remote work, complemented by regular off-site meetings scheduled in collaboration with your line manager. Healthcare & Dental. 20 days annual leave plus national holidays. Birthday off work, Wellbeing leave & Giving back days. Free access for you and your family to Calm, a mindfulness, health, and wellbeing App. 401k 4% employer contribution. Death in service (4x salary). Culture initiatives (Including Christmas rewards & monthly/quarterly social events). Training & Development opportunities with access to unlimited learning via Udemy.  
Chattanooga, TN, USA
$120,000-135,000/year
Workable
TeleOps Operator
Location: Las Vegas, NV Expected pay amount: $25.00 USD Per Hour Schedule: Multiple shifts/schedules available Assignment length: 6 month rolling contract (no end date) Job description JHCareers is helping an innovative, on-demand autonomous ride-hailing company hire a TeleOperations Operator to support its growing fleet of autonomous vehicles. This role is critical in ensuring the smooth operation of self-driving technology by monitoring vehicles, providing remote assistance when needed, and contributing to the ongoing improvement of the TeleOperations system. As a TeleOperations Operator, you will be the “human-in-the-loop,” bridging the gap between autonomous driving systems and real-world scenarios that require intervention. This position is perfect for candidates with a strong technical aptitude, excellent situational awareness, and the ability to remain calm under pressure. Various Shifts Available: Hours: 10:00 AM - 6:30 PM OR 5:30 PM - 2:00 AM Days: Multiple Shifts Available As a TeleOps Operator, you'll: Oversee a fleet of autonomous vehicles in real-time, providing remote guidance when necessary to ensure safe operation. Take control of vehicles in complex scenarios, following strict safety protocols and regulatory guidelines. Assist in gathering performance metrics and reporting observations to improve system functionality. Work cross-functionally to provide feedback on TeleOps tools, usability, and overall system performance to enhance the operator interface. Follow company protocols and regulatory requirements to maintain high operational standards. Commitment: This is a full-time, 6-month ongoing contract position. It will be onsite and available to candidates who are local to the Las Vegas, NV area. Requirements Requirements Excellent driving history and no criminal history 2+ years of experience in operations, technical support, software testing, or a similar field Comfortable working with Windows and Linux operating systems; basic understanding of QA testing principles. Excellent written and verbal communication skills Willingness to work flexible shift hours Bonus Qualifications: Experience with QA testing or working in the autonomous vehicle industry Bachelor’s degree in STEM, analytics, or related field Basic understanding of data analysis to help build out and analyze metrics Strong familiarity with video game-style controls or simulation software. Benefits Benefits: Pre-tax commuter benefits Employer Subsidized healthcare benefits Flexible Spending Account for healthcare-related costs Employer covers all costs for short and long term disability and life insurance 401k package
Las Vegas, NV, USA
$25/hour
Workable
Senior Benefit Calculation Analyst
Overview Legal & General is a leader in Pension Risk Transfer with over 35 years of experience globally, servicing over a million annuitants. Building on our global success, we established our Pension Risk Transfer platform in the US in 2015.  The business has grown steadily and in 2024 we completed $2.2 billion in premium written, representing our largest year on record. At Legal & General Retirement America, we aim to make a positive difference in the lives of our customers, partners, colleagues, and the communities in which they live.  We are passionate about what we do and how we do it. This means working with pace and energy to reach our goals and challenging ourselves to achieve more.  We strive to create a unique environment where balance between work and life is possible.  Purpose and Objective We are looking to add a Senior Calculation Analyst to our Retirement Support Services Team who will be responsible for the accurate and timely processing of moderate to high complexity benefit calculations. The analyst will also work on tasks related to the implementation of new GAC’s with respect to the deferred population. In addition, the analyst will lead and implement key projects and be the functional expert on specific applications and processes. Requirements Role and Responsibilities · Define, develop, and implement Group Annuity Contract specific standard methodologies and procedures which align with benefit specifications and associated plan or client requirements and comply with new or existing federal and state regulatory laws. · Understand complex pension calculation concepts for plans with different benefit structures. · Properly administer contracts in accordance with the plan sponsor requirements, with a focus on the deferred population and executing benefit calculations. · Support administration system transformation and new cases including creating test plans, plan specifications, and administering calculation testing of existing and new cases. · Process and handle monthly payments, new payment set ups, death processing and monthly reconciliation of files. · Assist or handle complex cases. Provide appropriate paperwork for new payments including QDRO’s and benefit quoting. · Assist Transition team with onboarding of new pension risk transfer plans and validating data in servicing systems, including mapping of deferred data fields in onboarding files and testing of the integration between the administration system and the calculator. · Create sample calculations for confirmation with Plan Sponsors to create clear documentation of GAC interpretation of benefit calculations. · Implement process automation solutions to deliver system improvements. Validate systems and workflows to ensure all new processes are functioning correctly including conducting UAT for system modifications. Identify defects and define options for remediation. · Collaborate on project scope, issues, and options. Accurately plan and appropriately complete projects. Participate in accurate and complete testing of new system updates. · Identify, track and report issues in a timely manner. Promptly provide comments, feedback, and recommendations. · Deliver training to junior team members as needed. · Participate in delivering continuing training to other departments on benefit calculation topics as needed. · Develop and document procedure manuals for Retirement Support Services. · Complete all other tasks and projects. Qualifications Bachelor’s Degree in a related field or equivalent work experience. 3+ years of retirement plan administration experience, including in depth pension benefit calculation knowledge. Strong analytical, organizational, and project management skills. Ability to balance multiple priorities in a fast-paced environment. Display history of building trust and developing team relationships. Exceptional oral and written communication skills as well as presentation skills; ability to deliver information in a concise manner. Advanced spreadsheet proficiency (Excel). Database capabilities (VBA, SQL) a plus. Proficiency in Microsoft Office product suite. Willingness to travel as needed.   We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation. Benefits We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation. 10 - 25 vacation days depending on experience level and years of service 4 floating holidays & 2 personal days 10 - 15 sick days, depending on years of service 2 paid volunteering days Health benefits, including medical, dental, and vision coverage Supplemental health benefits and life insurance 6 weeks of paid parental and maternal leave Immediate vesting into a 401k savings plan with up to 6% company match 100% employer-contributed Pension Plan - Cash Balance Plan after 1 year of service Flexible Workspace and Arrangements Tuition and Certification reimbursements Infertility and domestic partner benefits The expected hiring compensation range for this position is $70,000 - $80,000 USD annually. Base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. The current bonus target for the position is 5% of the base salary with a stretch to twice the target, modified for corporate and individual performance. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Stamford, CT, USA
$70,000/year
Workable
Technical Support Engineer
Engineer Solutions that Empower Students  Are you passionate about technology, troubleshooting, and making an impact in education? MasteryPrep is seeking a Technical Support Engineer to provide high-quality support to both internal teams and external users, ensuring seamless operations across our technology platforms. Join a team dedicated to using technology to empower educators and students nationwide. In this role, you will serve as a key technical resource for our customers, troubleshooting and resolving complex issues across full-stack web applications. You’ll use modern developer tools, databases, and reporting systems to diagnose problems, ensure smooth integrations, and deliver timely solutions. This hands-on position involves collaborating closely with development, QA, and product teams to reproduce and resolve defects, maintaining application stability, and driving continuous improvement. Success in this role requires both strong technical expertise and clear, empathetic communication, ensuring that every customer interaction leads to a reliable and positive experience. Key Responsibilities: Serve as the primary point of escalation for customers issues, addressing their technical inquiries and issues related to full-stack technologies. Provide timely troubleshooting and resolution of customer-reported bugs in web applications built with TypeScript and React. Diagnose and resolve database-related issues in PostgresSQL and Firestore, ensuring data integrity and performance optimization. Document, track, and escalate customer-reported bugs using Gitlab. Collaborate with development teams to reproduce, diagnose, and resolve software defects Lead maintenance engineering. Work closely with cross-functional teams, including development, QA, and product management, to resolve complex technical issues. Communicate effectively with customers, providing updates on the status of their requests and issues in a clear and timely manner. Gather feedback from customers to improve the support process and contribute to product enhancements. About MasteryPrep Nearly 90% of low-income students graduate high school without a college-ready ACT or SAT score. MasteryPrep’s mission is to level the playing field in education by offering the most effective test preparation available – made accessible to all students.  Through more than 10 successful years of partnering with school districts and institutions on college readiness services and resources, MasteryPrep has surpassed one million students served since the company’s founding in 2012.  MasteryPrep increased its student outreach by 70 percent in 2021 and is ranked among the Inc. 5000 “Fastest Growing Companies,” featured by “Entrepreneur 360,” and selected among the “Growth Leaders” by Louisiana Economic Development. Requirements Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience) 2+ years experience as a full-stack engineer Strong knowledge of Google Firestore, PostgreSQL, TypeScript, JaveScript, and React Experience with SSO,  specifically with Security Assertion Markup Language (SAML) protocols Proficient in integrating Learning Tools Interoperability (LTI) standards  Skilled in integrating with Student Information Systems (SIS)  Familiarity with rostering and integration services in education technology (e.g., Clever, ClassLink, Schoology) Excellent problem-solving and troubleshooting skills Ability to work independently and as part of a team in a fast-paced environment Strong communication and collaboration skills Familiarity with compliance standards such as FERPA, COPPA or PCI DSS preferred Knowledge of secure coding practices and application security testing techniques preferred Benefits $75,000-$85,000 starting salary based on qualifications  Opportunity to work with cutting-edge technologies in a collaborative environment Flexible work hours and remote work environment Professional development opportunities and reimbursement for certifications and training  Company-sponsored social events and team-building activities Employee benefits eligibility (health, disability, AD&D, life insurance) Matching 401k Paid time off Generous paid holidays
West Roxbury, Boston, MA, USA
$75,000/year
Workable
Senior Network Engineer
Symmetrio is seeking multiple Senior Network Engineers to support a major enterprise network transformation initiative for our customer, a large government organization. This role centers on the implementation of Juniper MX960 routers and the transition from MC-LAG to EVPN/VXLAN fabrics. This role will involve leading high-impact cutovers and migrations in a production environment, contributing to both hands-on implementation and network architecture design across a multi-overlay fabric. This is a hybrid position based out of Philadelphia, salary is in the 110-150k range. This is a 12 month contract with the possibility of extension. Responsibilities Lead the planning, prioritization, and execution of enterprise-scale Juniper router migrations (MX960 platform). Design and validate EVPN/VXLAN architectures with multiple overlays to ensure scalability, performance, and redundancy. Collaborate closely with the customer’s Network Engineering team to achieve seamless integration with minimal disruption during migrations. Configure, test, and deploy Junos OS across MX and EX platforms in production environments. Provide expert-level guidance on the migration from MC-LAG to EVPN, including design validation, testing, and troubleshooting. Develop and maintain detailed documentation for network designs, cutover strategies, and post-migration processes. Serve as a subject matter expert for Juniper routing, EVPN/VXLAN fabrics, and advanced routing protocols. Support after-hours cutovers and provide escalation assistance during critical events. Requirements 7+ years of experience as a Network Engineer in enterprise or large data center environments. 5+ years of hands-on experience with Juniper MX and EX platforms. Strong knowledge of core routing protocols, particularly BGP and OSPF. Proficiency with Junos OS configuration and troubleshooting in production environments. Demonstrated experience supporting large-scale router replacement or network migration projects. Familiarity with EVPN design, deployment, and operations. Strong analytical, troubleshooting, and problem-solving skills. Excellent communication and collaboration skills to work effectively with cross-functional engineering teams. Preferred Qualifications Juniper certifications (JNCIP, JNCIE, or equivalent). Experience with network automation and scripting (Python, Ansible, etc.). Knowledge of security best practices in routing and switching. Familiarity with large-scale enterprise change management and documentation processes. Benefits Health Care Plan (Medical, Dental & Vision) 401k Retirement Plan (4% match) Paid Time Off (Vacation, Sick & Public Holidays)
Philadelphia, PA, USA
$110,000-150,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.