Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Senior Data Engineer - Active Secret Clearance
Location: Washington, DC (Hybrid) Clearance Required: Active Secret Position Type: Full-Time We are seeking a highly skilled Senior Data Engineer to support the U.S. Coast Guard Office of Data & Analytics (ODA). The ideal candidate will bring expertise in Databricks, SQL, ETL pipelines, and cloud-based data frameworks to enable enterprise-scale analytics and decision-making. This role will involve designing, building, and orchestrating data pipelines, collaborating with analysts and developers, and implementing CI/CD practices to ensure scalable, reliable, and secure data solutions. Primary Responsibilities: Build, test, and orchestrate data pipelines in Databricks. Design and optimize data structures, schemas, and ETL processes. Translate business use cases into SQL queries, reports, and dashboards. Manage database objects in development environments without impacting production. Automate workflows using Databricks Workflows or the Jobs API. Integrate code into GitHub/GitLab and support CI/CD practices. Diagnose data gaps and quality issues, and design test cases for validation. Collaborate with developers and analysts to synchronize code and ensure reliability. Requirements Minimum Qualifications: Active Secret clearance (required at time of application). Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field. 7+ years of professional experience in data engineering. Expert-level proficiency in Databricks, Apache Spark, and SQL. Experience with ETL tools such as Kafka, Airflow, or AWS Glue. Proficiency with CI/CD pipelines and GitHub/GitLab version control. Knowledge of cloud platforms (AWS, Azure, GCP). Excellent problem-solving, debugging, and collaboration skills. Preferred Qualifications: Experience supporting federal or mission-critical analytics programs. Knowledge of data governance and metadata management practices. Familiarity with containerization or orchestration tools (Docker, Kubernetes). Eligibility: Must be legally authorized to work in the United States without employer sponsorship, now or in the future. Active Secret clearance required for this role. Benefits Salary: Competitive, commensurate with experience.
Washington, DC, USA
Negotiable Salary
Workable
Senior Data Scientist - Active Secret Clearance
Location: Washington, DC (Hybrid) Clearance Required: Active Secret Position Type: Full-Time We are seeking a highly skilled Senior Data Scientist to support enterprise data and analytics initiatives for our federal client. The ideal candidate will bring expertise in AI/ML development, advanced analytics, and automation to deliver mission-focused solutions. This role will involve providing technical leadership, developing predictive models, and collaborating with cross-functional teams to ensure analytics capabilities are scalable, secure, and aligned with enterprise objectives. Strong proficiency with Python, AI/ML frameworks, and RPA tools is required. Primary Responsibilities: Provide technical leadership on enterprise analytics and AI/ML solutions. Design, develop, and deploy machine learning models and predictive analytics. Utilize Python, Anaconda, and Jupyter notebooks for modeling and prototyping. Collaborate with Data Engineers to integrate models into scalable data pipelines. Support data governance activities including tagging, metadata management, and secure sharing. Develop RPA solutions to automate business processes. Evaluate and recommend analytics products to ensure mission alignment. Communicate findings through dashboards, data visualizations, and technical reports. Requirements Minimum Qualifications: Active Secret clearance (required at time of application). Bachelor’s or Master’s degree in Data Science, Computer Science, Mathematics, or a related field. 7+ years of professional experience in data science, AI/ML, and advanced analytics. Strong proficiency with Python, Anaconda, and Jupyter notebooks. Expertise in AI/ML frameworks such as TensorFlow, PyTorch, and Scikit-learn. Experience with RPA tools (UiPath, Automation Anywhere, or Python-based automation). Familiarity with Databricks, Apache Spark, and SQL. Excellent communication, documentation, and stakeholder engagement skills. Preferred Qualifications: Experience supporting federal or regulated environments. Knowledge of MLOps practices for deploying and managing ML models at scale. Background in data governance and enterprise metadata management. Eligibility: Must be legally authorized to work in the United States without employer sponsorship, now or in the future. Active Secret clearance required for this role. Benefits Salary: Competitive, commensurate with experience.
Washington, DC, USA
Negotiable Salary
Workable
Chief Technical Architect
Lead the strategic design and implementation of enterprise IT architecture that support national defense missions Shape the technological foundation of a next-generation network infrastructure and digital services Drive the strategic evolution of the IT network architectures to support digital advancements, cloud-native solutions, and customer-centric platforms Lead a team of architects to deliver innovative, scalable, and secure systems that position the organization at the forefront of the telecom industry Develop and maintain enterprise architecture frameworks to support mission-critical systems, including command and control, cybersecurity, and cloud-based platforms Design and implement an enterprise architecture framework that supports scalable cloud-native solutions, AI-driven platforms, and microservices architectures Collaborate with senior DoD leadership, military stakeholders, and inter-agency partners to align IT architectures with national security objectives Evaluate and integrate emerging technologies (e.g., AI/ML, zero-trust architecture, quantum-resistant cryptography) to maintain technological superiority Establish governance frameworks to ensure compliance with federal regulations (e.g., NIST 800-53, FISMA) and DoD cybersecurity standards Develop and maintain the enterprise architecture framework, including technology roadmaps, standards, and governance processes to guide IT investments and initiatives Oversee the evaluation, selection, and integration of emerging technologies, ensuring they align with industry trends and best practices Lead architecture reviews, audits, and optimization efforts to maintain a resilient and future-proof IT infrastructure Lead ITSM initiatives (ITIL-based) to optimize service delivery, including incident management, change management, and service continuity for high-availability systems Communicate complex architectural strategies to non-technical stakeholders, including senior military officials, interagency partners, and external contractors Supervise and mentor a team of architects and engineers to foster innovation and ensure alignment with DoD’s mission-driver culture Other duties as assigned Requirements Education/Training:  Bachelor’s Degree in relevant engineering or science discipline required Master’s Degree preferred ITIL v4 Foundation Certification preferred ITIL Strategic Leader Certification preferred DoDAF Certification (DoD Architecture Framework) preferred Certified Enterprise Architect (CEA) – FEAC Institute preferred Experience: 16+ years of professional experience in progressive IT Architecture 5+ years in a Chief Architect or equivalent role within a large-scale enterprise environment Proven industry experience in a chief architect role, demonstrating successful leadership of architecture teams and delivery of high-impact projects in and across multiple enterprise sectors such as Department of Defense, Public Sector, Commercial Broad technical expertise across multiple domains, including cloud computing (AWS, Azure, Google Cloud), cybersecurity, data analytics, AI/ML, DevOps, and enterprise software systems Proven experience designing architectures for large-scale enterprise systems, including cloud migrations and digital transformation projects In-depth understanding of IT service management (ITSM) frameworks and of ITIL framework and best practices, including incident management, problem management, change management, and service release management Experience leading and mentoring technical teams Security: Must be a US citizen Candidate must be in possession of a minimum DoD issued Secret Clearance and eligibility for TS/SCI Candidates with active current TS/SCI preferred Physical Requirements: Able to occasionally reach with hands and arms Prolonged periods of computer screen use, while sitting or standing at a desk Adhere to safety protocols when in work areas requiring use of PPE (e.g. eyewear, gloves, masks, hearing protection, steel toed shoes, etc.) Able to safely lift and carry up to 20 pounds at a time Benefits Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Short Term & Long Term Disability Training & Development Wellness Resources Salary: $180,000.00 - 220,000.00 Salary rates for this position are competitive and commensurate with experience and industry standards. We offer a comprehensive benefits package that may include health insurance, paid time off, and retirement savings options.
Colorado Springs, CO, USA
$180,000-220,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.