Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Cloud Software Engineer, Backend
Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.  Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.  Overview: Do you thrive in building robust, scalable backend systems for the cloud? Are you passionate about designing and implementing high-performance, secure applications? If so, then this Cloud Software Engineer, Backend role might be perfect for you! In this role, you will be an important member of our engineering team, responsible for the design, development, and maintenance of our backend cloud applications. You'll collaborate with our Cloud Architects, UX/UI designers, QA teams, and key hardware personnel and you will leverage your expertise in cloud technologies and backend development to build secure, reliable, and performant systems that meet our business needs. Key Responsibilities: Research competitors, design, develop, and maintain highly scalable and reliable backend services using cloud-native technologies. Collaborate with frontend engineers and other teams to ensure seamless integration. Select and utilize appropriate cloud technologies (e.g., AWS, Azure, OCI) to build and deploy applications. Optimize backend systems for performance, scalability, and cost-efficiency. Implement robust security measures to ensure data protection and application integrity. Develop various software (e.g., Windows/Linux/Hardware Box) with the same code which is in DDD architecture. Write clean, maintainable, and well-documented code. Automate infrastructure provisioning and deployment using tools like CI/CD pipelines. Troubleshoot and debug complex backend issues. Participate in code reviews & design reviews that are related to the modules that you are responsible for. Stay up to date on the latest cloud technologies and best practices. Requirements Bachelor's degree in Computer Science, Software Engineering, or a related field. 2+ years of experience in cloud backend software development. Proven experience designing and building scalable, reliable, and secure cloud-based applications. Strong proficiency in backend programming language Java and frameworks like SpringBoot, Service Mesh. Strong proficiency in JVM, multithreading programming, performance optimization skills. Experience with a specific cloud platform (AWS, Azure, OCI). Experience with cloud-based databases (e.g., NoSQL databases such as MongoDB, relational databases). Experience with distributed middleware (e.g. Message queue, config center). Experience with containerization technologies (e.g., Docker, Kubernetes). In-depth knowledge of backend technologies (e.g., APIs, message queues). Experience with security best practices for cloud environments. Excellent communication, collaboration, and problem-solving skills. Ability to work effectively in a team environment. Preferred Qualifications: Experience with DevOps principles and practices. Experience with serverless architectures. Experience with SDN Software Controller Platform. Experience with AI Ops. Benefits Salary range: $120,000 - $180,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$120,000-180,000/year
Workable
Java Developer
Role: Java Developer Location: Philadelphia, Philadelphia, PA Mandatory skills: Java, Spring, Jenkins, Tomcat, Python, MySQL, GIT, Test Automation Framework Development Bachelor's degree (or foreign equivalent) in Computer Science, Engineering, or a related technical field Define and develop test automation using the following: Java J2EE, Spring, Jenkins, Tomcat, Python, MySQL, GIT and Maven Deploy using Agile or Scrum in a DevOps environment. Additional advantage having +1 year of experience or domain in developing in video and broadband product architecture utilizing RDK/TDK suite. Key Job Responsibility: +5 years DevOps Practices: •Full Lifecycle Ownership: Oversee solutions through their entire lifecycle, from design to production deployment. •Comprehensive Solutioning: Design, develop, execute, train, operationalize, monitor, and triage end-to-end solutions. Focus on enhancing process quality and predictability. •Observability and Oversight: Improve observability to ensure comprehensive oversight of the end-to-end release readiness process. •Process Optimization: Develop and implement process improvements to boost team velocity and efficiency. •Collaboration and Integration: Work closely with other engineers, integrating business and functional priorities into solutions. Act as a key contributor in complex, high-stakes environments. •Operationalization: Successfully operationalize solutions in production to ensure seamless functionality and impact. 2.+5 years BDD and Test Automation Expertise: •Have a good understanding of Business-Driven Development strategy. •Explore advanced topics such as test data management, scenario refactoring, and integrating BDD with continuous integration/continuous deployment (CI/CD) pipelines. •Develop, and execute high-quality test plans efficiently on RDK stacks while leveraging automation and tooling to detect defects quickly and ensure the reliability of test coverages. 3. +5 years Tooling and Test Automation Infrastructure: •Get familiar with automation tools and frameworks for test development, execution, and reporting. •Maintaining test automation, including selecting appropriate tools, configuring environments, and integrating with version control systems. 4. +5 years Reliability Engineering and Process Optimization: •Explore strategies for optimizing validation coverage for home setups, standalone. •Practice DevOps to reduce the time between testbed delivery and acceptance by the receiving teams with reliability metrics 5. Collaboration and Communication Skills: •Effectively communicate and collaborate within the team and with stakeholders. •Practice agile methodologies to enhance teamwork and productivity. •Participate in cross-functional activities such as joint sprint planning, backlog grooming, and retrospective meetings to foster alignment and shared understanding across teams. 6. Continuous Learning and Improvement: •Practice continuous learning and improvement for ongoing skill development and career growth. •Stay updated on industry trends and best practices. •Put the team first. Value individual growth and collective success. 7. Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services. Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products, and services, especially our digital tools and experiences. 8. Win as a team - make big things happen by working together and being open to new ideas. Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs, and helping us elevate opportunities to do better for our customers. Drive results and growth. Respect and promote inclusion & diversity. Do what's right for each other, our customers, investors, and our communities.
Philadelphia, PA, USA
Negotiable Salary
Workable
TeleOps Operator
Location: Las Vegas, NV Expected pay amount: $25.00 USD Per Hour Schedule: Multiple shifts/schedules available Assignment length: 6 month rolling contract (no end date) Job description JHCareers is helping an innovative, on-demand autonomous ride-hailing company hire a TeleOperations Operator to support its growing fleet of autonomous vehicles. This role is critical in ensuring the smooth operation of self-driving technology by monitoring vehicles, providing remote assistance when needed, and contributing to the ongoing improvement of the TeleOperations system. As a TeleOperations Operator, you will be the “human-in-the-loop,” bridging the gap between autonomous driving systems and real-world scenarios that require intervention. This position is perfect for candidates with a strong technical aptitude, excellent situational awareness, and the ability to remain calm under pressure. Various Shifts Available: Hours: 10:00 AM - 6:30 PM OR 5:30 PM - 2:00 AM Days: Multiple Shifts Available As a TeleOps Operator, you'll: Oversee a fleet of autonomous vehicles in real-time, providing remote guidance when necessary to ensure safe operation. Take control of vehicles in complex scenarios, following strict safety protocols and regulatory guidelines. Assist in gathering performance metrics and reporting observations to improve system functionality. Work cross-functionally to provide feedback on TeleOps tools, usability, and overall system performance to enhance the operator interface. Follow company protocols and regulatory requirements to maintain high operational standards. Commitment: This is a full-time, 6-month ongoing contract position. It will be onsite and available to candidates who are local to the Las Vegas, NV area. Requirements Requirements Excellent driving history and no criminal history 2+ years of experience in operations, technical support, software testing, or a similar field Comfortable working with Windows and Linux operating systems; basic understanding of QA testing principles. Excellent written and verbal communication skills Willingness to work flexible shift hours Bonus Qualifications: Experience with QA testing or working in the autonomous vehicle industry Bachelor’s degree in STEM, analytics, or related field Basic understanding of data analysis to help build out and analyze metrics Strong familiarity with video game-style controls or simulation software. Benefits Benefits: Pre-tax commuter benefits Employer Subsidized healthcare benefits Flexible Spending Account for healthcare-related costs Employer covers all costs for short and long term disability and life insurance 401k package
Las Vegas, NV, USA
$25/hour
Workable
GNOSC Watch Officer (Network Engineer)
Expertise and Functions Perform all facets of a continuous 24/7 Global Network Operations and Security Center monitoring Execute network, system, and cloud systems monitoring/surveillance, environmental monitoring, incident management and MDA Cybersecurity Support and service maintenance activities to include Change Management coordination during the assigned shift day/time Engage in all aspects of IT incident management and escalation, ensuring that incidents are effectively escalated, managed and resolved with full communication of status, plans, and actions provided to executive management and the Government customer Utilize communication skills, verbal and written, at both technical and senior/Executive management levels Understand Command level Management Speak clearly to diverse cultural audiences, VIPs, and dignitaries Perform as a section trainer and create lesson plans Other duties as assigned Requirements Education/Training:  Bachelor’s Degree in management or other relevant discipline preferred Must have, or obtain within 6 months of hire, a current DoD 8570.01 IAT Level II Certification such as CompTIA Security+ CE Certification or higher    Experience: 2+ years of professional experience in the required task area    Preferred Experience:   Experience in metrics-based IT Operations and Maintenance (O&M) teams Experience with Remedy and SNMP monitoring tools (e.g., Solarwinds, Microfocus NNMi/HPOV, and Systems Center Operations Manager) Experience with ITIL framework and ITIL-based processes, to include continual service improvement, change management, and problem investigation Experience as a Windows/Linux System Administrator supporting a large Enterprise with knowledge of Microsoft Active Directory, Windows 2008/2012, Linux/UNIX Operating Systems, EMC Storage, Symantec NetBackup and SCCM Patch Management solutions Experience as a network engineer, including hands-on experience designing, implementing and managing network components including switches, routers, firewalls, and cryptographic devices Experience with Cyber-defense or information assurance, including experience with DISA mandated security tools to include Assured Compliance Assessment Solution (ACAS), Host Based Security System (HBSS), analyze results and create reports Experience with Network Operations in a network operations center or other 24x7x365 IT Operations environment Knowledge of IT Network Operations and connectivity devices that inter-relate with Public Key Infrastructure authentication and Information Security practices Knowledge of Cybersecurity principles and how to execute system/network security analysis Knowledge of Tier III Information Assurance practices, IT security governance, security administration, project management, logistics, and Cybersecurity compliance requirements Quality Assurance/Quality Control Inspection process knowledge Security: Must be a US citizen Candidate must be in possession of a minimum DoD issued Secret Clearance Physical Requirements: Able to occasionally reach with hands and arms Prolonged periods of computer screen use, while sitting or standing at a desk Adhere to safety protocols when in work areas requiring use of PPE (e.g. eyewear, gloves, masks, hearing protection, steel toed shoes, etc.) Able to safely lift and carry up to 20 pounds at a time Benefits Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Short Term & Long Term Disability Training & Development Wellness Resources Salary: $75,000 - 97,000 Salary rates for this position are competitive and commensurate with experience and industry standards. We offer a comprehensive benefits package that may include health insurance, paid time off, and retirement savings options.
Colorado Springs, CO, USA
$75,000-97,000/year
Workable
Linux Engineer
Resource Management Concepts, Inc. (RMC) provides high-quality, professional services to government and commercial sectors. Our mission is to deliver exceptional management and technology solutions supporting the protection and preservation of the people and environment of the United States of America. RMC is hiring a Linux Engineer in support of our Navy customer in Bethesda, MD.  The selected applicant will:  Patch and STIG Linux Operating to ensure compliance with DoD Information Assurance standards. Provide troubleshooting support for Linux/Windows Operating Systems Perform system updates and server configurations, including upgrades of the Operating System Implement changes to locally hosted workstations/servers Support virtual and physical networking configurations Provide hardware, software, and network troubleshooting Provide RedHat 8, or higher Enterprise administration, including workstations and servers Provide ACAS/Nessus vulnerability and scanning support Support distributed file systems Support Information Security Analyst in implementing and supporting cyber security standards to include NIST and Risk Management Framework (RMF) C&A Standards Document maintenance, repair, and test activities Create and maintain user accounts and install hardware/software Monitor status of LAN/WAN and circuit switching systems Write and maintain automation scripts for RHEL and other operating systems Qualifications: Demonstrated experience configuring and maintaining Linux servers and workstations Demonstrated knowledge and experience supporting Active Directory, Group Policy, and DNS Demonstrated Skills in three or more of the following: Red Hat Linux (RHEL), driver, applications, vulnerabilities, security requirements and postures, quarterly STIG updates, interact with corporate and vendor SMEs to solve complex problems, RMF experience, ACAS scanning, build and maintain Linux Systems Experience documenting trouble reports from STIGs to support computer equipment modifications Requirements Minimum of four (4) years of demonstrated experience administering Linux Systems Administrator. Must possess an IAT II 8140.03 baseline certification (Security+ CE, CCNA Security, CySA+, GICSP, GSEC, CND SSCP) or higher. Must possess Operating System (Linux) training and thereafter maintain the most current training. An active DoD Top Secret clearance is required. Applicant selected may be subject to a security investigation and must meet eligibility requirements for access to classified information. Experience in writing and managing Ansible playbooks, creating automation tasks via Ansible Automation Platform. Experience managing RedHat Satellite Server, including provisioning, package synchronization, and patch management lifecycle. Familiarity with centralized Identity Management solutions. Benefits At RMC, we're committed to your career growth! RMC differentiates itself from other firms through its investment in our employees. We invest our resources to train, certify, educate, and build our employees. RMC can offer you a great place to work with a small company feel and give you the experience, tuition assistance, and certifications that will take your career to the next level. This includes a competitive paid vacation package with 11 paid federal holidays. We also offer high-quality, low-deductible healthcare plans, pet insurance, and a competitive 401K package. Salary at RMC is determined by various factors, including but not limited to location, a candidate's specific combination of education, knowledge, skills, competencies, and experience, as well as contract-specific requirements. The current salary range for this position will be $110,000 to $130,000 (annually). #IND123 #LL-MP1
Bethesda, MD, USA
$110,000-130,000/year
Workable
Site Reliability Engineer (req-174)
Team CATHEXIS elevates the government contracting experience through rapid response, deep skill, and thoughtful problem-solving and communication. Our core capabilities are our top-tier program and project management, data analytics, and audit services, the backbone of which is our integrated approach to operational excellence. You worked hard to get to where you are. You strive to make every day better than the day before. So do we. Team CATHEXIS operates with an all-in mindset. We are working together to create a company that supports our shared values and individual goals. Our values are centered around Respect, Engagement, Customer Service, Integrity, Teamwork, and Excellence in everything we do for our employees, clients, partners, and communities. We believe success is best when we listen and lead with empathy; model high standards of ethics to provide a rewarding candidate experience; work hard, have fun, and appreciate the strengths we all bring to the team; and empower our employees to create innovative and trusted results. We are looking for a dynamic Site Reliability Engineer (SRE) to join our team.  The Site Reliability Engineer (SRE) will manage, monitor, and optimize our clusters on Kubernetes. Together, we’re accelerating our clients’ digital transformation through the building and deployment of data-driven, scalable AI solutions.  The ideal candidate will have a deep understanding of Kubernetes, Cloud Infrastructure, and Infrastructure as Code (IaC) practices. You will be responsible for ensuring the reliability and scalability of our Kubernetes clusters and Cloud Infrastructure. Responsibilities: Monitor and Manage Kubernetes Clusters: Ensure the stability, health, and scalability of Kubernetes Clusters, deploying applications and services on Kubernetes Kubernetes Management: Deploy, monitor, and scale applications on Kubernetes clusters. Maintain Helm charts, manage services, and ensure resource allocation for optimal cluster performance Cloud Infrastructure Management: Work with leading Cloud Platforms (AWS, GCP, Azure) to set up, configure, and manage infrastructure resources using Infrastructure as Code (Terraform, CloudFormation, etc.) Monitoring & Incident Response: Set up monitoring solutions, define alerts, and manage the incident response process for any issues related to Jenkins, or Kubernetes clusters Automate Infrastructure Processes: Build automation tools for scaling, monitoring, and maintaining infrastructure using modern tools like Terraform, Ansible, or equivalent Collaborate Across Teams: Work closely with development, services, and operations teams to ensure a seamless integration between application development and infrastructure Security & Compliance: Ensure all systems follow best practices in terms of security and compliance with relevant regulations. This includes role-based access, encryption, and automated vulnerability scanning Requirements: Active Secret Clearance is required Bachelor’s degree (or equivalent) in computer science or related discipline A minimum of two(2) years of experience working with on-premise and off-premise cloud environments Experience with AWS, Azure and / or GCP Ability to program (structured and OOP) using one or more high-level languages, such as Python, Java, C/C++, Ruby, and JavaScript Experience with distributed storage technologies such as NFS, HDFS, Ceph, and Amazon S3, as well as dynamic resource management frameworks (Apache Mesos, Kubernetes, Yarn) Proactive approach to identifying problems, performance bottlenecks, and areas for improvement Agile/Scrum experience CATHEXIS offers competitive compensation packages to all eligible employees. Our goal is to provide a compensation package that reflects the value you bring to our team, is competitive with market rates, and promotes your financial security and personal well-being. The annual salary range for this role is $136,000 - $170,000. Please note that the salary information provided is a general guideline. CATHEXIS considers various factors in its final offer, including location, qualifications, experience, and skills.  CATHEXIS is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law. If you are an individual with a disability and would like to request a reasonable accommodation as part of the employment selection process, please contact the Recruiting@cathexiscorp.com.
Tysons, VA, USA
$136,000-170,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.