Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Embedded Software Engineer (Wireless)
Headquartered in the United States, TP-Link Systems Inc. is a leading global provider of networking devices and smart home products. Consistently ranked as the world's top provider of Wi-Fi devices, TP-Link is dedicated to delivering innovative solutions that improve people’s lives by offering faster, more reliable connectivity. Serving customers in over 170 countries, we are committed to expanding our global footprint. At TP-Link Systems Inc., we believe that technology has the power to transform the world for the better. Our mission is to design reliable, high-performance products that connect users worldwide to the limitless possibilities of technology. We are driven by our core values of professionalism, innovation, excellence, and simplicity. Our goal is to help clients achieve outstanding global performance and to provide consumers with a seamless, effortless technology experience. Overview: As a Wireless Systems Integration Engineer at TP-Link, you will play a key role in integrating wireless chipsets and optimizing our advanced mesh and IoT networking solutions. You will collaborate with leading chipset manufacturers on product design and development, contributing to the latest Wi-Fi technologies, such as WiFi7 products. Your responsibilities include assisting in the development and optimization of wireless drivers and firmware, as well as developing RF calibration software. Additionally, you will conduct wireless performance testing, refine mesh and configuration features, and work with cross-functional teams to troubleshoot complex issues. This position is vital for enhancing the performance, reliability, and innovation of TP-Link's wireless networking solutions. Key Responsibilities: Participate in the evaluation and selection of various wireless chipsets. Assist with bring-up tasks, including driver adaptation, script adaptation, and functionality adaptation for designated chipsets. Support the implementation of a framework for integrating different wireless chipsets. Assist in the integration, development, and optimization of new Wi-Fi chipsets, OS, wireless drivers, and firmware to ensure reliable performance and connectivity. Stay updated on the latest 802.11 wireless protocols, industry technologies, and standards, helping to develop certification software for compliance. Contribute to the design and implementation of wireless and Mesh-related functionalities, ensuring high-quality code and proper documentation. Develop software for RF calibration to ensure precise and optimal wireless performance. Participate in code reviews, providing feedback to maintain coding standards and best practices. Help design and implement self-testing standards for wireless modules, engaging in the self-testing process to identify and address quality issues during development. Track and resolve basic technical issues related to connectivity, stability, and performance by utilizing various debugging tools (such as Wireshark, Tcpdump, or similar), and collaborate with vendors as necessary. Oversee the software release process and collaborate with on-site factory teams, potentially requiring on-site support to troubleshoot and resolve production issues. Address customer, market, and factory feedback to improve product performance and user satisfaction. Conduct competitive analysis and keep informed about industry trends to assist in product strategy Requirements Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field. 2+ years of experience in wireless driver development, specifically in Wi-Fi, Bluetooth, or Thread technologies. Proficiency in C or C++ programming. Demonstrated experience troubleshooting Wi-Fi issues. Proficient in the use of basic wireless debugging tools, including Tcpdump, iPerf, Wireshark and similar tools for performance analysis and troubleshooting. Solid understanding of wireless communication protocols, including 802.11a/b/g/n/ac/ax. Familiarity with advanced wireless communication protocols, such as 802.11be, 802.11ad/ay, and Bluetooth/BLE. Basic understanding of wireless roaming and mesh technologies, such as 802.11k/v/r,802.11s or EasyMesh. Experience with Wi-Fi 6 or Wi-Fi 7 chipsets.   Preferred Qualifications: Strong communication and interpersonal skills. Experience in developing and optimizing wireless firmware and drivers. Ability to conduct RF calibration and performance testing. Willingness to travel to factory sites to address production issues as needed. Benefits Salary range: $100,000 - $130,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$100,000-130,000/year
Workable
Dot Net developer
Job Description Dot Net developer with 5-7 years of hands-on development experience . Role involves working directly with clients to understand business requirements and deliver solutions. Collaborating closely with business stakeholders and offshore teams to ensure seamless communication and successful project execution. Requirements: 5-7 years of hands-on experience in DotNet development, with profiency in C#, VB.Net. Strong understanding of the .NET framework, including ASP.NET, ASP.NET Core, and related technologies. Proficiency in database design and SQL, with experience in SQL Server or other database technologies. Experience with web development technologies, including ASP.NET, MVC, APIs, and potentially front-end technologies like HTML, CSS, JavaScript Experience in client-facing roles, with the ability to translate business requirements into technical solutions. Collaborating with business and offshore teams to deliver successful projects. Troubleshoot and resolve complex technical issues in a timely manner. Participate in code reviews, ensuring high standards of quality, performance, and security. Contribute to the architecture and design of software solutions in line with industry best practices. Strong knowledge of software development life cycle, Agile methodologies, and version control systems (e.g., Git). Excellent problem-solving skills and attention to detail. Strong communication skills, with the ability to engage with both technical and non-technical stakeholders. Preferred Skills: Experience with microservices architecture. Knowledge of cloud platforms like AWS, Azure, or Google Cloud. Familiarity with DevOps practices and CI/CD pipelines.
Englewood Cliffs, NJ 07632, USA
Negotiable Salary
Workable
Senior Data Scientist - Active Secret Clearance
Location: Washington, DC (Hybrid) Clearance Required: Active Secret Position Type: Full-Time We are seeking a highly skilled Senior Data Scientist to support enterprise data and analytics initiatives for our federal client. The ideal candidate will bring expertise in AI/ML development, advanced analytics, and automation to deliver mission-focused solutions. This role will involve providing technical leadership, developing predictive models, and collaborating with cross-functional teams to ensure analytics capabilities are scalable, secure, and aligned with enterprise objectives. Strong proficiency with Python, AI/ML frameworks, and RPA tools is required. Primary Responsibilities: Provide technical leadership on enterprise analytics and AI/ML solutions. Design, develop, and deploy machine learning models and predictive analytics. Utilize Python, Anaconda, and Jupyter notebooks for modeling and prototyping. Collaborate with Data Engineers to integrate models into scalable data pipelines. Support data governance activities including tagging, metadata management, and secure sharing. Develop RPA solutions to automate business processes. Evaluate and recommend analytics products to ensure mission alignment. Communicate findings through dashboards, data visualizations, and technical reports. Requirements Minimum Qualifications: Active Secret clearance (required at time of application). Bachelor’s or Master’s degree in Data Science, Computer Science, Mathematics, or a related field. 7+ years of professional experience in data science, AI/ML, and advanced analytics. Strong proficiency with Python, Anaconda, and Jupyter notebooks. Expertise in AI/ML frameworks such as TensorFlow, PyTorch, and Scikit-learn. Experience with RPA tools (UiPath, Automation Anywhere, or Python-based automation). Familiarity with Databricks, Apache Spark, and SQL. Excellent communication, documentation, and stakeholder engagement skills. Preferred Qualifications: Experience supporting federal or regulated environments. Knowledge of MLOps practices for deploying and managing ML models at scale. Background in data governance and enterprise metadata management. Eligibility: Must be legally authorized to work in the United States without employer sponsorship, now or in the future. Active Secret clearance required for this role. Benefits Salary: Competitive, commensurate with experience.
Washington, DC, USA
Negotiable Salary
Workable
Cybersecurity / Data Compliance Analyst - Active Secret Clearance
Location: Washington, DC (Hybrid) Clearance Required: Active Secret Position Type: Full-Time We are seeking a skilled Cybersecurity / Data Compliance Analyst to support enterprise data and analytics initiatives for our federal client. The ideal candidate will bring expertise in security assessments, compliance frameworks, and risk management to ensure that systems and data practices meet federal cybersecurity requirements. This role will involve supporting Assessments & Authorizations (A&A), managing POA&Ms, conducting risk assessments, and aligning cybersecurity and data governance practices across mission-critical programs. Strong communication, documentation, and stakeholder engagement skills are essential, along with hands-on experience in eMASS and federal security standards. Primary Responsibilities: Support Assessments & Authorizations (A&A) processes in eMASS. Develop, track, and manage Plans of Action & Milestones (POA&Ms). Conduct risk assessments of systems and enterprise data processes. Collaborate with system owners and engineers to ensure compliance with federal security policies and standards (FISMA, NIST, DHS directives). Document findings, recommendations, and remediation actions for leadership and stakeholders. Assist in aligning data governance and cybersecurity practices across teams. Support internal and external compliance audits and reporting requirements. Provide advisory support on data protection, metadata management, and secure data sharing. Requirements Requirements Minimum Qualifications: Active Secret clearance (required at time of application). Bachelor’s degree in Cybersecurity, Information Systems, or a related field. 5+ years of experience in cybersecurity compliance, risk management, or A&A. Hands-on experience with eMASS and POA&M lifecycle management. Familiarity with NIST Risk Management Framework (RMF) and DHS/DoD security standards. Strong knowledge of FISMA, FedRAMP, and information assurance policies. Excellent documentation, analytical, and stakeholder communication skills. Preferred Qualifications: Security certifications such as Security+, CISSP, CISM, or equivalent. Experience supporting federal or regulated environments. Knowledge of secure data governance and metadata management practices. Eligibility: Must be legally authorized to work in the United States without employer sponsorship, now or in the future. Active Secret clearance required for this role. Benefits Salary: Competitive, commensurate with experience.
Washington, DC, USA
Negotiable Salary
Workable
Business Data Steward - Active Secret Clearance
Location: Washington, DC (Hybrid) Clearance Required: Active Secret Position Type: Full-Time We are seeking a skilled Business Data Steward to support enterprise data and analytics initiatives for our federal client. The ideal candidate will bring expertise in data governance, metadata management, and ensuring enterprise-wide data quality and integrity. This role will involve collaborating across business and technical teams to ensure that data assets are accurate, consistent, and aligned with mission objectives. Strong communication, documentation, and stakeholder management skills are required, along with hands-on experience in governance frameworks and metadata tools. Primary Responsibilities: Serve as the primary steward for assigned data domains, ensuring compliance with governance standards. Support data tagging, metadata management, and enterprise data sharing processes. Collaborate with Data Engineers and Scientists to integrate governance requirements into pipelines and analytics products. Monitor and enforce data quality standards while identifying gaps and inconsistencies. Maintain documentation of data definitions, lineage, and usage. Provide input on enterprise data policies, standards, and best practices. Partner with business stakeholders to align data management practices with operational needs. Support audits, compliance reviews, and security requirements related to sensitive data. Requirements Requirements Minimum Qualifications: Active Secret clearance (required at time of application). Bachelor’s degree in Information Systems, Data Management, or a related field. 5+ years of experience in data stewardship, data governance, or metadata management. Strong knowledge of data governance frameworks and best practices. Familiarity with metadata management and data cataloging tools. Working knowledge of SQL and ability to collaborate with technical data teams. Excellent documentation, communication, and stakeholder engagement skills. Preferred Qualifications: Experience working in federal or regulated environments. Knowledge of data quality assessment methodologies and metrics. Background in supporting enterprise data management or analytics programs. Eligibility: Must be legally authorized to work in the United States without employer sponsorship, now or in the future. Active Secret clearance required for this role. Benefits Salary: Competitive, commensurate with experience.
Washington, DC, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.