Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Craigslist
DELIVERY DRIVERS- IMMEDIATE HIRING! (Sacramento)
DELIVERY DRIVER/HELPER POSITION IMMEDIATE OPENING! BLUE BIRD EXPRESS CARGO, LLC is pleased to announce our immediate opening for the following position at our Sacramento, CA warehouse location: DELIVERY DRIVER -Must be able to driver a 16’ foot box truck to delivery products including appliances, and household goods. -Must be able to deliver products to our service delivery areas/territories in a timely and professional manner. -Must be able to interact with customers in a professional manner. -Must be able to use route navigation apps and knowledge or area to delivery products to the customers on time. -Maintain electronic logs to track routes and deliveries -Ability to manage time and routes for a streamlined delivery experience -Strength to lift up to 70 lbs. plus bending and twisting -Work well independently, open and transparent communication -Familiarity with GPS devices or map apps DELIVERY HELPER -Must be able to interact with customers in a professional manner -Must be able to assist Delivery drivers to ensure the products are delivered in a timely and professional manner. -Ability to manage time and routes for a streamlined delivery experience -Strength to lift up to 70 lbs. plus bending and twisting -Work well independently, open and transparent communication -Familiarity with GPS devices or map apps SALARY IS COMMENSURATE TO EXPERIENCE. WE OFFER COMPETITIVE COMPENSATION
820 Hill Ct, West Sacramento, CA 95605, USA
Negotiable Salary
Workable
EDM Master Applications Developer
**This position is contingent on contract award** RMC is seeking a highly skilled Master Applications Developer to serve as the EDM Technical Lead for the United States Marine Corps Cyberspace Operations Group (MCCOG) in Quantico, VA. This role is critical in supporting the technical, engineering, operations, maintenance, and management functions that ensure the security and effectiveness of the Marine Corps Enterprise Network (MCEN). The MCEN supports over 200,000 users globally, operating behind NIPRNET and SIPRNET boundaries, and includes a complex suite of enterprise virtual server infrastructure, storage area networks, and messaging environments.   Key Responsibilities   Lead and mentor senior technical teams operating in a geographically distributed, classified network environment supporting over 200,000 users. Oversee the engineering, deployment, and maintenance of enterprise-level Active Directory, Microsoft Exchange, SAN, and Virtualization environments. Provide technical leadership for the design, integration, and management of firewalls, routers, switches, VPN devices, and enterprise virtual server infrastructure. Engineer and manage enterprise NetApp storage and VMware virtualization solutions. Utilize Microsoft System Center to automate and optimize critical operational tasks. Ensure compliance with cybersecurity best practices and maintain a tightly integrated, agile, defensible, and survivable network supporting both distributed operations and business enterprise needs. Collaborate with stakeholders to analyze user needs, troubleshoot technical issues, and implement innovative solutions. Guide and supervise system modifications, conduct security audits, and ensure the continuous improvement of network operations. Maintain documentation and provide regular assessments, maintenance, and enhancements of existing applications and infrastructure. Serve as the subject matter expert for enterprise network operations and contribute to strategic planning and risk management. Requirements Minimum seven (7) years of experience leading senior technicians in a geographically distributed, classified network environment. At least five (5) years of experience supporting enterprise-level Active Directory, Microsoft Exchange, SAN, and Virtualization environments. Information Assurance Technical (IAT) Level III certification. AZ-800/801 or M365 Enterprise Admin certification TS/SCI security clearance. ITIL v4 Foundation Certification. Demonstrated experience supporting enterprise network environments with at least 200,000 users. Proven expertise in engineering and managing enterprise NetApp storage and VMware solutions. Desired Skills   Strong technical leadership and mentoring abilities. Excellent problem-solving skills and the ability to innovate under pressure. Exceptional communication and interpersonal skills for effective collaboration with both technical and non-technical stakeholders. Commitment to continuous learning and staying current with industry trends and emerging technologies. Ability to manage multiple priorities in a fast-paced, mission-critical environment.   Benefits At RMC, we're committed to your career growth! RMC differentiates itself from other firms through its investment in our employees. We invest our resources to train, certify, educate, and build our employees. RMC can offer you a great place to work with a small company feel and give you the experience and certifications that will take your career to the next level. RMC also offers high-quality, low-deductible healthcare plans and a competitive 401K package. * Salary at RMC is determined by various factors, including but not limited to location, a candidate's specific combination of education, knowledge, skills, competencies, and experience, as well as contract-specific requirements. The current salary range for this position will be $140,000.00 to $174,000.00 annually.
Quantico, VA 22134, USA
$140,000-174,000
Workable
.NET API Specialist
Role: .NET API Specialist Location: Dallas, TX(4 days onsite)- . Yrs of exp:10+   Your responsibilities in this role will include: Lead the design, development, and implementation of robust and scalable .NET Core APIs. Hands-on Knowledge on SQL queries Collaborate with cross-functional teams to gather requirements and architect solutions. Hands-on coding and debugging of API components to ensure high performance and reliability. Mentor junior developers and provide technical guidance and support. Stay current with industry trends and best practices, particularly in cloud technologies. Extensive experience in developing .NET APIs using C#. Strong proficiency in cloud platforms such as AWS, Azure, or Google Cloud Platform. Demonstrated expertise in designing and implementing RESTful APIs. Solid understanding of software development methodologies and practices. Excellent communication skills and ability to collaborate effectively with teams. Knowledge of microservices architecture. Familiarity with DevOps practices and tools.   Requirements: Bachelor’s degree in computer science, Engineering, or a related field. Proven experience as a .NET/C# Developer with a minimum of 8 years in software development. Strong proficiency in C#, ASP.NET, and the .NET Framework. Solid understanding of software development principles and best practices. Good in database systems (Oracle RDBMS, etc.). Excellent problem-solving and communication skills. Ability to work independently and collaboratively within a team. Primary skills:  SQL NET API AZURE AWS KUBERNETES ORACLE RDBMS KAFKA DOCKER KUBERNETES CI/CD PIPELINE C#
Dallas, TX, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.