Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
API Kong Engineer
API Kong Engineer Location: Phoenix, AZ (Hybrid – 3-5 days/week from office) Duration: 12 months Experience:8+Years   Job Description: We are seeking a skilled API Developer / Integration Engineer who is proficient in managing and optimizing APIs using KONG Gateway. As part of our team, you will be responsible for designing, developing, and deploying API solutions that enhance our platform’s functionality and performance. Responsibilities: Design and implement scalable API solutions using KONG Gateway. Collaborate with cross-functional teams to gather and understand integration requirements. Develop custom plugins and middleware to extend KONG Gateway functionalities. Optimize API performance and security through monitoring, tuning, and troubleshooting. Implement API management best practices including versioning, documentation, and access control. Integrate APIs with various backend systems and databases. Ensure high availability and reliability of APIs by implementing robust failover and redundancy strategies. Stay updated with the latest industry trends and advancements in API management and integration. Requirements: Proven experience in designing and developing APIs using KONG Gateway. Strong understanding of RESTful API design principles and best practices. Proficiency in programming languages such as Python, Node.js, or Java. Experience with containerization technologies like Docker and orchestration tools such as Kubernetes. Familiarity with API security standards (OAuth, JWT, SSL/TLS). Ability to troubleshoot complex API issues and performance bottlenecks. Excellent communication skills and the ability to collaborate effectively with team members. Proven experience as a Kong API expert or similar role. Strong knowledge of API design and development principles. Proficiency in Kong API gateway configuration and management. Experience with Kong plugins, Lua, and Kong Enterprise features. Familiarity with RESTful APIs, OAuth, JWT, and other API security protocols. Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus. Strong troubleshooting and problem-solving skills.   Preferred Skills: Experience with other API gateways (e.g., Apigee, AWS API Gateway) is an advantage. Knowledge of cloud platforms (e.g., AWS, Azure, GCP).Experience with DevOps practices and CI/CD pipelines. Familiarity with logging and monitoring tools (e.g., ELK stack, Prometheus). Preferred Qualifications: KONG Certified Developer or Administrator. Experience with other API gateways and management platforms. Knowledge of microservices architecture and design patterns.  
Phoenix, AZ, USA
Negotiable Salary
Workable
iOS Engineer (Women's Health)
Our mission at Oura is to empower every person to own their inner potential. Our award-winning products help our global community gain a deeper knowledge of their readiness, activity, and sleep quality by using their Oura Ring and its connected app. We've helped over one million people understand and improve their health by providing daily insights and practical steps to inspire healthy lifestyles. Empowering the world starts with living our values and empowering our team. As a quickly growing company focused on helping people live healthier and happier lives, we ensure that our team members have what they need to do their best work — both in and out of the office.  Our engineering organization consists of many talented Android and iOS app developers distributed across the EU and US. All app developers collaborate closely on each platform, regardless of location or specific feature squad. For day-to-day feature work, our engineers are organized into smaller cross-functional feature squads or teams. Our squads have a great deal of autonomy and are responsible for the development and architecture of their features. Squads take full ownership of their code and handle everything from concepting, design and implementation to release, maintenance and bug fixes. This is a remote US role with a preference for candidates based in the US-Pacific timezone. We have offices in San Francisco and San Diego for those who prefer hybrid or office settings. We also have employee hubs in New York City, Boston, Los Angeles, Seattle, and more. Our teams are growing and we are searching for iOS engineers at all levels (minimum 3 years of experience) to help build and maintain key features in our iOS app. You will join a team that truly cares about Oura’s mission, product, and the quality of user experience. You and your team will work together to push the boundaries of what’s possible with wearable products. What you will do:  Work together with other engineers to improve our app experience and codebase Deliver and maintain high quality code for projects on the roadmap Push our products forward by closely aligning with PMs and Designers Collaborate with other teams such as firmware, data, backend, or science to implement new features in the Oura mobile app Requirements We would love to have you on our team if you have: Minimum 3+ years of professional development experience shipping iOS apps Strong experience with Swift, modern iOS app architectures, and common third-party libraries and frameworks Experience with collaborative development on complex shared codebases Proficiency with git, branching, and standard code review workflows Focus on quality through unit tests and manual testing Computer science fundamentals and design patterns We also appreciate if you have: 5+ years of professional development experience shipping iOS apps Any of the following: Swift structured concurrency, Combine, SQLite/GRDB, UIKit, SwiftUI, CoreAnimation, CoreGraphics, C++, PyTorch, ML algorithms, TypeScript, CI/CD, or Kotlin Multiplatform Ability to take ownership of projects and design technical solutions Experience with Agile or Scrum processes Experience with systems architecture and performance optimization Experience working asynchronously across countries and time zones Experience working with firmware teams on projects involving hardware Experience developing health, wellness, fitness, or women’s health products Experience with ML algorithms, encryption, or data privacy Experience with functional programming Benefits At Oura, we care about you and your well-being. Everyone here at Oura has a ring of their own and we are continually looking to improve employee health. What we offer: Competitive salary and equity packages Health, dental, vision insurance, and mental health resources An Oura Ring of your own plus employee discounts for friends & family 20 days of paid time off plus 13 paid holidays plus 8 days of flexible wellness time off Paid sick leave and parental leave Oura takes a market-based approach to pay, which may vary depending on your location. US locations are categorized into tiers based on a cost of labor index for that geographic area. While most offers will be closer to the starting range, successful candidates' pay will be determined based on job-related skills, experience, qualifications, work location, internal peer equity, and market conditions. These ranges may be modified in the future. Region 1 $142,000- $178,000  Region 2 $130,000- $163,000  Region 3 $120,000- $150,000 A recruiter can determine your zones/tiers based on your US location. We are not considering candidates residing in the following states: Alaska (AK), Delaware (DE), Iowa (IA), Mississippi (MS), Missouri (MO), Nebraska (NE), Oklahoma (OK), Rhode Island (RI), South Dakota (SD), Vermont (VT), West Virginia (WV), and Wisconsin (WI) Oura is proud to be an equal opportunity workplace. We celebrate diversity and are committed to creating an inclusive environment for all employees. Individuals seeking employment at Oura are considered without regard to age, ancestry, color, gender (including pregnancy, childbirth, or related medical conditions), gender identity or expression, genetic information, marital status, medical condition, mental or physical disability, national origin, protected family care or medical leave status, race, religion (including beliefs and practices or the absence thereof), sexual orientation, military or veteran status, or any other characteristic protected by federal, state, or local laws. We will not tolerate discrimination or harassment based on any of these characteristics. We will work to ensure individuals with disabilities are provided reasonable accommodation to participate in the interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Disclaimer: Beware of fake job offers! We’ve been alerted to scammers posing as ŌURA recruiters, especially for remote roles. Please note: Our jobs are listed only on the ŌURA Careers page and trusted job boards. We will never ask for personal information like ID or payment for equipment upfront. Official offers are sent through Docusign after a verbal offer, not via text or email. Stay cautious and protect your personal details. To all recruitment agencies: Oura does not accept agency resumes. Please do not forward resumes to our jobs alias, Oura employees, or any other organization's location. Oura is not responsible for any fees related to unsolicited resumes.
San Francisco, CA, USA
$120,000-178,000/year
Workable
Oracle IDM /ADF - Washington, DC (Long-Term)
Title: Oracle IDM (Oracle Identity Management) Location: Washington, DC Position: Contract Duration: 1+ Year’s Rate: $Market/Hr Job Overview & Responsibilities:- The candidate will provide technical consulting/advisory, implementation, as well as general maintenance and operational support services to our clients in the following areas: • Experience with Oracle IDM (Oracle Identity Management) OR Oracle ADF. • Experience with Sailpoint Identity IQ, including design, development and implementation skills. • Experience in implementation of enterprise-level, and distributed server-side applications Integration experience with database server technologies such as Microsoft SQL, Oracle, etc. • Integration experience with web server technologies such as Apache, IIS, etc. • Integration experience with directory server technologies such as Active Directory, openLdap, etc. • Ability to meet project schedule deliverables • Demonstrated ability to write documentation deliverables including recommendations, assessments, root cause analyses, project roadmaps, and other reports • Must possess excellent Microsoft Word, Excel, Visio, and PowerPoint skills • Security product certifications desired; CISSP • General Web development and programming skills with either Java, .NET, PHP, HTML, XML, CSS, Perl, shell, or SQL are highly desirable • Experience with smart card technology, Smart Card Management Systems, and PKI a plus • Must be familiar with Federal policies and standards on information security and authentication (FIPS, NIST, PIV, etc.) • Solid understanding of Federal credentialing standards (PIV, PIV-I/C, TWIC, FRAC, etc.) • Experience in assessment, evaluation, and design of solutions related to encryption and key management, identity management, strong authentication, and end-point security • Experience in implementation of federation/SAML technologies such as ADFS, etc. Requirements Note: If interested please send your updated resume to gowri.sankar@two95intl.com and include your Salary requirement along with your contact details with a suitable time when we can reach you. If you know of anyone in your sphere of contacts, who would be a perfect match for this job then, we would appreciate if you can forward this posting to them with a copy to us. We look forward to hearing from you at the earliest!
Washington, DC, USA
Negotiable Salary
Workable
Data Engineer (USA)
Trexquant is a growing systematic fund manager with a core team of highly accomplished technologists. We apply a wide variety of statistical and machine learning techniques to build investment portfolios and trade our client assets in global equity and futures markets. With locations in the US, China and India, our global team in excess of 50 employees is comprised primarily of research professionals with advanced science, math and technology degrees who explore the universe of quantitative methods for opportunities to enhance and adapt our platform and profit in an exciting and dynamic environment. We are seeking a dedicated and detail-oriented Data Engineer to join our team. The primary goal of this team is to assist researchers in writing, downloading and reading scripts, effectively translating their ideas into data variables for trading purposes. The ideal candidate will have a strong background in data engineering, excellent scripting skills, and a keen understanding of financial data and trading strategies. Responsibilities Collaborate with researchers to understand their data requirements and trading strategies. Develop and maintain scripts for downloading, reading, and processing data from various sources. Ensure data accuracy, consistency, and reliability by implementing quality control measures. Optimize data retrieval processes for efficiency and performance. Assist in the integration of new data sources and formats into the existing data infrastructure. Provide technical support and troubleshooting for data-related issues. Document data workflows, processes, and scripts for future reference and knowledge sharing. Stay updated with industry trends and advancements in data engineering and financial data. Requirements A degree in a technical discipline (computer science, mathematics, statistics, physics, etc.)  1+ years of experience in Python as used in data capacity Experience in financial services and working with financial data providers is a plus Ability to work independently and take projects to completion, quickly learn new systems, think creatively and pay attention to details Benefits Competitive salary plus bonus bonus based on individual and company performance Collaborative, Casual, and friendly work environment PPO Health, dental and vision insurance premiums fully covered for you and your dependents Pre-tax commuter benefits Weekly company meals Trexquant is an Equal Opportunity Employer
Stamford, CT, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.