Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Software Engineer, Skill Level 2
At Avalore, we are a mission-driven, veteran-owned small business that helps government agencies harness the power of data and emerging technologies to solve complex problems. Our team combines deep technical expertise with a passion for public service, delivering innovative, responsible solutions in AI, data governance, cybersecurity, and enterprise transformation. Joining Avalore means working alongside experts who have successfully led high-impact initiatives across the DoD and Intelligence Community, and being part of a company that values integrity, agility, and purpose. Your responsibilities will include: Develops, maintains, and enhances complex and diverse software systems (e.g., processing-intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, and business management information systems) based upon documented requirements.  Analyze user requirements to derive software design and performance requirements  Design and code new software or modify existing software to add new features  Debug existing software and correct defects  Integrate existing software into new or modified systems or operating environments  Develop simple to complex data queries for existing or proposed databases or data repositories  Provide recommendations for improving documentation and software development process standards  Works individually or as part of a team.  Reviews and tests software components for adherence to the design requirements and documents test results.  Utilizes software development and software design methodologies appropriate to the development environment.  Provides specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of Commercial Off-the-shelf (COTS)/Government Off-the-shelf (GOTS) in place of new development, and requirements analysis and synthesis from system level to individual software components. Requirements Bachelor’s degree in a technical discipline from an accredited college or university is required + Fourteen (14) years’ experience as a SWE in programs and contracts of similar scope, type, and complexity  Four (4) years of relevant SWE experience may be substituted for the degree  Ability to work independently and manage multiple priorities. TS/SCI and Special Security Accesses and Polygraph required. Applicants must be currently authorized to work in the United States on a full-time basis. Avalore will not sponsor applicants for work visas for this position. Desired: Cloud, CNO, DevOps, Data Analytics, Machine Learning & AI  Benefits Eligibility requirements apply. Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Short Term & Long Term Disability Training & Development Employee Assistance Program
Fort Meade, MD, USA
Negotiable Salary
Workable
Numerical Algorithm Software Engineer
SciTec is a dynamic small business, with the mission to deliver advanced sensor data processing technologies and scientific instrumentation capabilities in support of National Security and Defense, and we are growing our creative team! We support customers throughout the Department of Defense and U.S. Government in building innovative new tools to deliver unique world-class data exploitation capabilities. Important Notice: SciTec exclusively works on U.S. government contracts that require U.S. citizenship for all employees. SciTec cannot sponsor or assume sponsorship of employee work visas of any type. Further, U.S. citizenship is a requirement to obtain and keep a security clearance. Applicants that do not meet these requirements will not be considered. SciTec has immediate opportunities for talented software & algorithm developers and engineers to support programs focusing on low-latency data processing, fusion, and tracking algorithms for exploitation of remote sensing systems. Our ideal candidate will work well in multiple software languages as part of a rapid pace, collaborative, small-team environment consisting of Scientists, Engineers, and Developers and be able to prototype and develop advanced algorithms leading to eventual integration in C++ on Linux operating systems as part of government frameworks. Responsibilities Research new algorithms and analysis techniques for remote sensor data exploitation Demonstrate fluent, idiomatic mastery of Python and/or C++; comfort with software design and architecture Develop proof-of-concept signal processing, image processing, and data exploitation tools in Python Characterize quality/performance of algorithms and sensor systems Work as part of an Agile team and contribute to shared tools Other duties as assigned Requirements Colorado Residents: In any materials you submit, you may redact or remove age-identifying information such as age, date of birth, or dates of school attendance or graduation. You will not be penalized for redacting or removing this information. A bachelor’s degree in the physical sciences, mathematics, engineering, or computer science At least five years of ongoing professional experience in defense and/or defense-related technological fields (additional years of education may be substituted for years of experience) Professional experience with state estimation, tracking, or Guidance, Navigation, and Control (GNC) Professional experience and fluency in the following languages: C++, Python Fluency with Linux operating systems Ability to work full-time in-person in Boulder, CO office location Detail oriented with good verbal and written communication skills Candidates who have any of the following skills will be preferred A current active DoD SECRET security clearance or higher An advanced degree in the physical sciences, mathematics, engineering, or computer science Professional experience with application orchestration and/or deployment to the cloud Professional experience with Agile software development Professional experience with the exploitation and analysis of OPIR, E/O, SAR, Spectral, RF, or other remotely sensed data Benefits SciTec offers a highly competitive salary and benefits package, including: Employee Stock Ownership Plan (ESOP) 3% Fully Vested Company 401K Contribution (no employee contribution required) 100% company paid HSA Medical insurance, with a choice of 2 buy-up options 80% company paid Dental insurance 100% company paid Vision insurance 100% company paid Life insurance 100% company paid Long-term Disability insurance 100% company paid Hospital Indemnity insurance Voluntary Accident and Critical Illness insurance Short-term Disability insurance Annual Profit-Sharing Plan Discretionary Performance Bonus Paid Parental Leave Generous Paid Time Off, including Holiday, Vacation, and Sick Pay Flexible Work Hours The pay range for this position is $117,000 - $168,000 / year. SciTec considers several factors when extending an offer of employment, including but not limited to the role and associated responsibilities, a candidate's work experience, education/training, and key skills. This is not a guarantee of compensation. SciTec is proud to be an Equal Opportunity employer. VETS/Disabled.
Boulder, CO, USA
$117,000-168,000/year
Workable
Full Stack Developer - Need Only Locals to GA
Job Description :   We are seeking a talented Full Stack Developer to join our team at iSoftTek Solutions Inc. As a Full Stack Developer, you will be responsible for designing, developing, and maintaining our web applications and software solutions. You will collaborate with cross-functional teams to deliver high-quality and scalable software products.   Responsibilities: Design, develop, and maintain web applications using modern technologies and frameworks Collaborate with product owners, designers, and other stakeholders to gather requirements and translate them into technical specifications Write clean and efficient code following industry best practices Perform code reviews for team members and provide constructive feedback Optimize application performance and ensure scalability Troubleshoot and debug issues reported by clients and users Stay up-to-date with the latest trends and technologies in web development   Requirements: Bachelor's degree in Computer Science, Software Engineering, or a related field Minimum of 3 years of experience as a Full Stack Developer Proficient in front-end technologies such as HTML, CSS, JavaScript, and JavaScript frameworks like React or Angular Strong knowledge of back-end technologies such as Java, Python, or Node.js Experience with databases such as MySQL or MongoDB Knowledge of version control systems like Git Excellent problem-solving and communication skills Ability to work independently and in a team environment Must be a local resident of Georgia, USA Requirements Requirement Summary: Bachelor's degree in Computer Science, Software Engineering, or related field 3+ years of experience as a Full Stack Developer Proficiency in HTML, CSS, JavaScript, and JavaScript frameworks (React, Angular) Strong knowledge of back-end technologies (Java, Python, Node.js) Experience with databases (MySQL, MongoDB) Knowledge of version control systems (Git) Excellent problem-solving and communication skills Ability to work independently and in a team environment Must be a local resident of Georgia, USA
Atlanta, GA, USA
Negotiable Salary
Craigslist
Build a Career in Software Development 🧑‍💻
We are inviting dedicated individuals ready to pursue careers in technology. If you want to gain real coding experience, complete major projects, and prepare for junior developer jobs, this program is for you. This remote program provides nearly 900 hours of structured training and can be taken full-time or part-time. You will learn programming languages, developer tools, and workflows while building a résumé and portfolio for employers. 🖥️ Technology & Programming Fundamentals -Understand computer systems, networks, browsers, and internet functions -Study algorithms, data structures, security basics, and number systems -Practice Python scripting, command line tools, and flowchart design 💻 Web & Front-End Development -Build responsive websites with HTML5, CSS3, and Bootstrap -Create interactive apps using JavaScript, jQuery, and React.js -Practice modern web design and layout techniques 🗄️ Back-End & Database Development -Design and manage databases with SQL and SQL Server -Perform CRUD operations and relational database modeling -Build scalable applications with Python (Django) and C# (.NET Core) 🧑‍💻 Programming Languages & Tools -Learn C#, Python, JavaScript, HTML, CSS, SQL, and more -Use Git, GitHub, Visual Studio, and Team Foundation Server -Apply professional coding collaboration and version control 🧪 Capstone Projects -Complete two advanced projects (Python + C#) -Build portfolio-ready applications using Agile, Scrum, and DevOps -Practice debugging, teamwork, and problem-solving skills 🧰 Career Preparation -Learn résumé and cover letter writing for the tech industry -Practice coding interviews and whiteboard techniques -Prepare for entry-level developer opportunities 🚀 No prior training necessary. Remote-friendly program. Begin your journey as a developer today. 👉 Apply here: https://softwaredevpros.online/
2901 Andorra Ct, Parkville, MD 21234, USA
$30/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.