Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Numerical Algorithm Software Engineer
SciTec is a dynamic small business, with the mission to deliver advanced sensor data processing technologies and scientific instrumentation capabilities in support of National Security and Defense, and we are growing our creative team! We support customers throughout the Department of Defense and U.S. Government in building innovative new tools to deliver unique world-class data exploitation capabilities. Important Notice: SciTec exclusively works on U.S. government contracts that require U.S. citizenship for all employees. SciTec cannot sponsor or assume sponsorship of employee work visas of any type. Further, U.S. citizenship is a requirement to obtain and keep a security clearance. Applicants that do not meet these requirements will not be considered. SciTec has immediate opportunities for talented software & algorithm developers and engineers to support programs focusing on low-latency data processing, fusion, and tracking algorithms for exploitation of remote sensing systems. Our ideal candidate will work well in multiple software languages as part of a rapid pace, collaborative, small-team environment consisting of Scientists, Engineers, and Developers and be able to prototype and develop advanced algorithms leading to eventual integration in C++ on Linux operating systems as part of government frameworks. Responsibilities Research new algorithms and analysis techniques for remote sensor data exploitation Demonstrate fluent, idiomatic mastery of Python and/or C++; comfort with software design and architecture Develop proof-of-concept signal processing, image processing, and data exploitation tools in Python Characterize quality/performance of algorithms and sensor systems Work as part of an Agile team and contribute to shared tools Other duties as assigned Requirements Colorado Residents: In any materials you submit, you may redact or remove age-identifying information such as age, date of birth, or dates of school attendance or graduation. You will not be penalized for redacting or removing this information. A bachelor’s degree in the physical sciences, mathematics, engineering, or computer science At least five years of ongoing professional experience in defense and/or defense-related technological fields (additional years of education may be substituted for years of experience) Professional experience with state estimation, tracking, or Guidance, Navigation, and Control (GNC) Professional experience and fluency in the following languages: C++, Python Fluency with Linux operating systems Ability to work full-time in-person in Boulder, CO office location Detail oriented with good verbal and written communication skills Candidates who have any of the following skills will be preferred A current active DoD SECRET security clearance or higher An advanced degree in the physical sciences, mathematics, engineering, or computer science Professional experience with application orchestration and/or deployment to the cloud Professional experience with Agile software development Professional experience with the exploitation and analysis of OPIR, E/O, SAR, Spectral, RF, or other remotely sensed data Benefits SciTec offers a highly competitive salary and benefits package, including: Employee Stock Ownership Plan (ESOP) 3% Fully Vested Company 401K Contribution (no employee contribution required) 100% company paid HSA Medical insurance, with a choice of 2 buy-up options 80% company paid Dental insurance 100% company paid Vision insurance 100% company paid Life insurance 100% company paid Long-term Disability insurance 100% company paid Hospital Indemnity insurance Voluntary Accident and Critical Illness insurance Short-term Disability insurance Annual Profit-Sharing Plan Discretionary Performance Bonus Paid Parental Leave Generous Paid Time Off, including Holiday, Vacation, and Sick Pay Flexible Work Hours The pay range for this position is $117,000 - $168,000 / year. SciTec considers several factors when extending an offer of employment, including but not limited to the role and associated responsibilities, a candidate's work experience, education/training, and key skills. This is not a guarantee of compensation. SciTec is proud to be an Equal Opportunity employer. VETS/Disabled.
Boulder, CO, USA
$117,000-168,000/year
Workable
Software Engineer with Clearance
What is Aviture? Aviture is a full-service technology consulting firm with expertise in software solutions for both commercial and government organizations. We believe software doesn’t mean anything unless it solves a problem, so we create technology to enable users, open possibilities, and create meaningful impact. “I wanted to create a company that I would have wanted to work at when I was an engineer.” — Mark Griffis, President We are headquartered in Omaha, Nebraska, with remote employees across the nation: Las Vegas, Washington D.C., Austin, Dallas, Portland, Green Bay, Kansas City, Madison, Minneapolis, and Orlando, just to name a few. What is Aviture’s Art of the Possible? Along with our mission-driven team’s deep expertise in a wide range of development languages, we employ a disciplined agile approach to define goals upfront, keep organizational value at the forefront, and set the pace for rapid, iterative innovation that transforms organizations. We call this the Art of the Possible. The solutions we’ve created have: Saved lives in the California wildfires and southern U.S. flooding Provided security for the 2020 Presidential Inauguration, Super Bowl, and post-attack Boston Marathon Enabled augmented-reality training environments for surgeons Increased transparency and promoted patient wellness in hospitals and senior care facilities Combined computer vision and robotics to automate dangerous manual labor tasks And much more! Why You’ll Want to Live Aviturian Aviturians create technology that makes a meaningful difference in someone’s life. We’re a team made up of designers, engineers, developers, and inventors who believe technology’s purpose is to empower users to change the world. Here are the values that guide us: Embody integrity Seek ownership Stay hungry Remain grounded Create impact Challenge with respect We’ve built our culture around creativity, continuous learning, and our shared values. If that sounds like something you’d like to be a part of, then join us today! Software Engineer Aviture is hiring a Software Engineer. Aviturians understand how technology can change the world and have the technical skills to make those visions a reality. Aviturians are always eager to learn, share, collaborate, grow, and innovate. (We also share a good meme or thirty.) We’re looking for a rockstar Software Engineer who will… Work with a cross-functional team to design, develop, test and deploy innovative solutions to a wide range of complex business problems. Actively participate in all aspects of our agile development process. Utilize effective debugging techniques to identify and resolve software defects. Continuously keep themselves up to date on changes in technology, with an emphasis on the tech stacks being used by your team. Sound like you? Apply today: Requirements BS degree in Software Engineering related degree, similar technical field of study or equivalent practical experience. Excellent verbal and written communication skills. Able to respectfully challenge the status quo. Experience developing and maintaining large-scale applications using one or more general purpose programming languages, such as:Python, Java, C#/.NET, Go, JavaScript, TypeScript Experience with one or more modern frontend technologies is a plus: ReactJS, AngularJS, VueJS, etc. Able to work both autonomously, as well as collaboratively among a team of your peers. Excellent grasp of computer science concepts, proven ability to solve complex technical problems. Experience using common design patterns in the software industry. High personal standards for code quality, maintainability, and performance. This position will require the employee to have a Secret level Government clearance or the ability to obtain one. This position will require the employee to work in person at an off-site location. Benefits PPO or a High Deductible Health Plan, HSA eligible plan, Dental, Vision, and Supplemental Life. Generous paid time off that starts accruing on day one. Hybrid work environment with quarterly Castaway Week events in the Omaha HQ Office, all expenses paid, from across the country to participate in team-building, collaboration, and fun events. Company vacations!!! Previous destinations have included Napa Valley, Cancun, Cabo San Lucas and Aspen. Matching 401k with 100% vesting in six months. Pick your preferred workstation! Mac? PC? We’ll support you with the tech you need to do your best work. Get paid to go to national and international conferences and training, so that you can stay up to date with the latest innovations. Flexible work schedules: Work the times that fits your schedule, with all meetings required to be scheduled between 9 am and 3 pm CST. Free lunch every Friday and recurring team events for you and your family to enjoy. Incentive and bonus pay. Opportunities for connection and growth through peer coaching, recurring Lightning Talks to share things we’re passionate about, and a bi-weekly company-wide All Hands.
Omaha, NE, USA
Negotiable Salary
Workable
Senior Backend Platform Engineer, Distributed Systems
Help redefine how the DoD makes multi-billion-dollar force-design decisions. In this role, you'll fuse physics-driven simulation, interactive computing, and verified AI code-generation to create next-generation wargaming platforms. If building ultra-low-latency APIs, taming high-volume geospatial data, and leading with clean, production-ready Python gets you fired up, let’s talk. What you’ll do Own the service layer—design, build, and scale FastAPI micro-services and lightning-fast ZeroMQ messaging pipelines running in Kubernetes and bare-metal clusters. Wrangle data at speed & scale—shape and query multi-TB Postgres/PostGIS datasets, orchestrate Redis for sub-millisecond state, and keep everything rock-solid under bursty load. Glue the stack together—expose crisp, well-versioned REST & WebSocket endpoints for the frontend crew and simulation kernel. Ship continuously—automate CI/CD, observability, and security hardening to DoD standards; push to prod with confidence. Lead by doing—drive code reviews, mentor teammates, and set the standard for test coverage and documentation. Why Code Metal? Mission with impact: your APIs become the nervous system of digital battlefields influencing multi-billion-dollar defense acquisitions. Velocity: tight-knit teams, weekly releases, zero bureaucratic drag. Ownership: no passengers—every engineer ships code that matters. Requirements Must-have credentials 4+ years building production backends in modern Python, with deep FastAPI (or equivalent async framework) experience. Proven expertise in ZeroMQ, NATS, Kafka, or similar high-throughput messaging systems. Hands-on with Postgres/PostGIS and Redis in performance-critical workloads. Cloud-native chops—Docker, Kubernetes, and one major provider (AWS, GCP, Azure, or GovCloud). Active Secret clearance or eligibility to obtain one.  Bonus points C++ or Rust skills for bridging high-performance simulation modules. Hardened services for FedRAMP / STIG compliance. Observability mindset—Prometheus, Grafana, OpenTelemetry. TS/SCI clearance. Benefits Health care plan with 100% premium coverage, including medical, dental, and vision. 401k with 5% matching. Paid Time Off (Uncapped Vacation, plus Sick & Public Holidays). Flexible hybrid work arrangement. Relocation assistance for qualifying employees.
Boston, MA, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.