Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Data & BI Senior Data Engineer
Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a specialization in Matillion, SSIS, Azure DevOps, and ETL processes. This role will involve designing, developing, testing, and deploying ETL jobs, collaborating with cross-functional teams, and ensuring efficient data processing. Key Responsibilities: Design, develop, test, and deploy Matillion ETL jobs in accordance with project requirements. Collaborate with the Data and BI team to understand data integration needs and translate them into Matillion ETL solutions. Create and modify Python code/components in Matillion jobs. Identify opportunities for performance optimization and implement enhancements to ensure efficient data processing. Collaborate with cross-functional teams, including database administrators, data engineers, and business analysts, to ensure seamless integration of ETL processes. Create and maintain comprehensive documentation for Matillion ETL jobs, ensuring knowledge transfer within the team. Create, test, and deploy SQL Server Integration Service (SSIS) packages and schedule them via Active Batch scheduling tool. Create Matillion deployment builds using Azure DevOps CI/CD pipeline and perform release manager activities. Review code of other developers (L2, L3-BI/DI) to ensure code standards and provide approval as part of code review activities. Resolve escalation tickets from the L2 team as part of the on-call schedule. Working knowledge of API and Postman tool is an added advantage. Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 5+ years of experience in data engineering, with a focus on ETL processes. Proficiency in Matillion, SSIS, Azure DevOps, and ETL. Strong knowledge of SQL, Python, and data integration techniques. Experience with performance optimization and data processing enhancements. Excellent collaboration and communication skills. Ability to work in a fast-paced, dynamic environment. Preferred Skills: Experience with cloud platforms such as AWS or Azure. Knowledge of data warehousing and data modeling. Familiarity with DevOps practices and CI/CD pipelines. Strong problem-solving skills and attention to detail.
Atlanta, GA, USA
Negotiable Salary
Craigslist
Senior System/Network Engineer (novato)
Job Title: Senior System/Network Engineer Location: Novato, CA Job Type: Full-Time About Us: Marin IT, Inc. is a leading Managed Service Provider (MSP) dedicated to delivering exceptional IT support and services to a diverse range of clients. We specialize in providing comprehensive IT solutions, including system and network management, cybersecurity, cloud services, and more. Our team is passionate about technology and committed to delivering top-notch service and support. Position Overview: We are seeking an experienced and highly skilled Senior System/Network Engineer to join our dynamic team. The ideal candidate will have a strong background in managing and optimizing complex IT infrastructures, with a focus on delivering exceptional service to our clients. This role requires a deep understanding of networking, server administration, virtualization, and security. The Senior System/Network Engineer will work closely with our clients to design, implement, and maintain their IT environments, ensuring optimal performance and security. Key Responsibilities: • Design, deploy, and maintain complex network and system infrastructures for our clients. • Manage and support a variety of IT environments, including on-premises, cloud, and hybrid systems. • Troubleshoot and resolve advanced technical issues related to network and system performance, security, and connectivity. • Implement and manage security protocols and best practices to protect client data and systems. • Conduct regular system and network performance monitoring, analysis, and optimization. • Provide expert-level technical support and guidance to clients and internal teams. • Lead projects to upgrade and migrate systems, ensuring minimal disruption to client operations. • Develop and maintain comprehensive documentation of client environments, configurations, and procedures. • Stay up-to-date with emerging technologies and industry trends to provide innovative solutions to clients. • Mentor and support junior engineers, fostering a collaborative and knowledge-sharing environment. Qualifications: • Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience). • Minimum of 5 years of experience in system and network engineering, preferably in an MSP environment. • Proficiency in managing and troubleshooting Windows and Linux servers, network infrastructure (routers, switches, firewalls), and virtualization technologies (VMware, Hyper-V). • Strong understanding of TCP/IP, DNS, DHCP, VPNs, and other networking protocols and services. • Experience with cloud platforms such as AWS, Azure, or Google Cloud. • In-depth knowledge of cybersecurity best practices, including firewalls, antivirus, IDS/IPS, and data encryption. • Excellent problem-solving skills and the ability to work under pressure to meet deadlines. • Strong communication and interpersonal skills, with the ability to interact effectively with clients and team members. • Relevant certifications such as CCNA, CCNP, MCSA, MCSE, VCP, or equivalent are highly desirable. Benefits: • Competitive salary and performance-based bonuses. • Comprehensive health, dental, and vision insurance. • Retirement savings plan with company match. • Professional development opportunities and reimbursement for certifications. • A supportive and collaborative team environment.
488 Calle Arboleda, Novato, CA 94949, USA
Negotiable Salary
Workable
Software Engineer, Skill Level 2
At Avalore, we are a mission-driven, veteran-owned small business that helps government agencies harness the power of data and emerging technologies to solve complex problems. Our team combines deep technical expertise with a passion for public service, delivering innovative, responsible solutions in AI, data governance, cybersecurity, and enterprise transformation. Joining Avalore means working alongside experts who have successfully led high-impact initiatives across the DoD and Intelligence Community, and being part of a company that values integrity, agility, and purpose. Your responsibilities will include: Develops, maintains, and enhances complex and diverse software systems (e.g., processing-intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, and business management information systems) based upon documented requirements.  Analyze user requirements to derive software design and performance requirements  Design and code new software or modify existing software to add new features  Debug existing software and correct defects  Integrate existing software into new or modified systems or operating environments  Develop simple to complex data queries for existing or proposed databases or data repositories  Provide recommendations for improving documentation and software development process standards  Works individually or as part of a team.  Reviews and tests software components for adherence to the design requirements and documents test results.  Utilizes software development and software design methodologies appropriate to the development environment.  Provides specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of Commercial Off-the-shelf (COTS)/Government Off-the-shelf (GOTS) in place of new development, and requirements analysis and synthesis from system level to individual software components. Requirements Bachelor’s degree in a technical discipline from an accredited college or university is required + Fourteen (14) years’ experience as a SWE in programs and contracts of similar scope, type, and complexity  Four (4) years of relevant SWE experience may be substituted for the degree  Ability to work independently and manage multiple priorities. TS/SCI and Special Security Accesses and Polygraph required. Applicants must be currently authorized to work in the United States on a full-time basis. Avalore will not sponsor applicants for work visas for this position. Desired: Cloud, CNO, DevOps, Data Analytics, Machine Learning & AI  Benefits Eligibility requirements apply. Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Short Term & Long Term Disability Training & Development Employee Assistance Program
Fort Meade, MD, USA
Negotiable Salary
Workable
Full Stack Developer - Need Only Locals to GA
Job Description :   We are seeking a talented Full Stack Developer to join our team at iSoftTek Solutions Inc. As a Full Stack Developer, you will be responsible for designing, developing, and maintaining our web applications and software solutions. You will collaborate with cross-functional teams to deliver high-quality and scalable software products.   Responsibilities: Design, develop, and maintain web applications using modern technologies and frameworks Collaborate with product owners, designers, and other stakeholders to gather requirements and translate them into technical specifications Write clean and efficient code following industry best practices Perform code reviews for team members and provide constructive feedback Optimize application performance and ensure scalability Troubleshoot and debug issues reported by clients and users Stay up-to-date with the latest trends and technologies in web development   Requirements: Bachelor's degree in Computer Science, Software Engineering, or a related field Minimum of 3 years of experience as a Full Stack Developer Proficient in front-end technologies such as HTML, CSS, JavaScript, and JavaScript frameworks like React or Angular Strong knowledge of back-end technologies such as Java, Python, or Node.js Experience with databases such as MySQL or MongoDB Knowledge of version control systems like Git Excellent problem-solving and communication skills Ability to work independently and in a team environment Must be a local resident of Georgia, USA Requirements Requirement Summary: Bachelor's degree in Computer Science, Software Engineering, or related field 3+ years of experience as a Full Stack Developer Proficiency in HTML, CSS, JavaScript, and JavaScript frameworks (React, Angular) Strong knowledge of back-end technologies (Java, Python, Node.js) Experience with databases (MySQL, MongoDB) Knowledge of version control systems (Git) Excellent problem-solving and communication skills Ability to work independently and in a team environment Must be a local resident of Georgia, USA
Atlanta, GA, USA
Negotiable Salary
Craigslist
Desktop Support Tech I/II --- Temporary for 4 - 8 weeks (Sacramento)
Desktop Support Technician level I/II (temporary) needed for approximately 4 – 8 weeks. The work is to begin on or around September 29, 2025, and would include visiting various sites for our client, in and around the greater Sacramento, CA area. Mileage will be reimbursed at the federal rate. We are seeking a Desktop Support Technician on a temporary basis (for approximately 4 – 8 weeks) to complete Windows 11 upgrades and perform reimaging on laptops and desktops. This would include setting up users and some end user training as needed as well as possibly replacing hard drives. The hours would primarily be Monday – Friday 8:00 to 5:00 but might require afterhours work but would be rare if any. The candidates selected must have pervious Desktop Support experience in a business environment including: upgrading desktops and laptops to Windows 11, reimaging and end user training. This is an onsite position, and the person selected MUST have reliable personal transportation, be punctual and dependable with excellent professional customer service skills. They must also have a clean state and federal background check. This temporary position (for approximately 4 - 8 weeks) would begin on or about September 29, 2025. The hourly pay rate is $25 – $27 per hour. Candidates who meet the above criteria should attach a resume along with their current availability and desired hourly pay rate.
1029 J St, Sacramento, CA 95814, USA
$25-27/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.