Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
BI Data Analyst
Rea is a growing Top 100 business advisory & accounting firm providing our clients services in tax, accounting, and business consulting. We have a ‘People First’ culture and we focus on our employees’ well-being and professional development. With over 400 professionals and locations throughout Ohio, our firm has a culture that respects a work-life balance for our team. We also provide competitive compensation and a robust benefits plan. The BI Data Analyst will play a critical role in leveraging Power BI and Azure SQL to analyze data, build data sets, develop insightful reports, and create efficient workflows. The role’s use of these tools will contribute to data-driven decision-making and process optimization across our organization.  Responsibilities Utilize Power BI to gather and transform data from various sources (IE Excel, APIs, SQL), creating visually appealing and interactive dashboards to present key insights to stakeholders   Collaborate with cross-functional teams to understand data requirements and design meaningful visualizations that drive informed decisions   Design robust generalized SQL datasets through combining raw data for reports.  Work closely with end-users to gather requirements and ensure that dashboards meet their needs effectively   Identify opportunities for reporting and process automation across internal clients and implement solutions that deliver tangible benefits   Apply data cleansing and transformation techniques using Power Query to ensure data accuracy and consistency across different data sources   Collaborate with data warehouse engineers to enhance data quality and resolve data integration issues   Collaborate with team members to share best practices, provide technical guidance, and support the adoption of Power Platform tools   Train end-users on using Power BI, Power Apps, and Power Automate effectively for their respective needs   Ensure compliance with data governance policies and implement security measures to protect sensitive data within Power Platform solutions   Stay up-to-date with Microsoft's updates and features related to Power Platform to maintain best practices   Knowledge, Skills and Abilities Proficiency in data analysis, visualization, and report creation using Power BI   Strong understanding of data transformation, ETL processes, and data modeling concepts   Familiarity with data governance principles and best practices for maintaining data accuracy and security   Excellent communication skills, both written and verbal, to convey technical concepts to non-technical stakeholders   Analytical mindset with the ability to translate business requirements into effective Power BI Dashboards or power platform apps.  Problem-solving skills to troubleshoot issues and optimize Power Platform applications   Experience working in a collaborative team environment and a track record of delivering results on time   Requirements Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or a related field   Proven experience (5+ years) as a Data Analyst, with demonstrated expertise in Microsoft Power Platform tools (Power BI, Power Apps, Power Automate) , intermediate SQL knowledge Hands-on experience developing custom Power BI Dashboards, analyzing data within SQL databases, building company wide usable datasets Analyzing raw data and identifying useful metrics and new ways of looking at data to help drive the business Travel to client locations as needed   Benefits Rea offers a wide variety of benefits to help support our employees' health, wellness and financial goals. Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Family Leave (Maternity, Paternity) Short Term & Long Term Disability Training & Development Wellness Resources Four (4) weeks PTO Twelve (12) paid holidays, of which three (3) are floating holidays Rea does not accept unsolicited resumes from individual recruiters or third-party recruiting agencies without pre-approval from Rea’s Talent team. Pre-approval is required before any external candidate can be submitted. Rea will not be responsible for fees related to unsolicited resumes and for candidates who are sent directly to our hiring managers.
Dublin, OH, USA
Negotiable Salary
Workable
Senior Software Engineer, Hub Team
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Software Engineer, Hub Team in California (USA). We are seeking a Senior Software Engineer to join a dynamic team responsible for enhancing the user experience across a bundled gaming platform. This role focuses on designing and implementing experiments and features that improve acquisition, conversion, retention, and monetization. The ideal candidate will collaborate closely with product, design, and data teams to deliver seamless, engaging experiences across connected devices, including smart TVs and voice-activated platforms. This position offers an exciting opportunity to influence the full user journey while contributing to a fast-paced, innovative environment that values rapid iteration, data-driven decision making, and architectural excellence. Accountabilities ·         Partner with Product and Design teams to refine requirements, create technical specifications, and deliver features from concept to launch ·         Develop experiments and features that drive acquisition, activation, retention, and monetization ·         Make key technical decisions balancing rapid iteration with long-term architectural health ·         Mentor junior engineers, conduct code reviews, and maintain high standards for code quality, performance, and architecture ·         Collaborate cross-functionally with data analysts to design data-driven experiments and optimize user experiences ·         Contribute to the evolution of the platform’s technology stack and feature set Requirements ·         6+ years of software engineering experience building products with scalable user bases and/or revenue ·         Experience in growth engineering or rapid experimentation environments, including A/B testing and feature flagging systems ·         Strong product sense and empathy for end users, with a focus on delivering meaningful value ·         Full-stack development proficiency, preferably with TypeScript, Node.js, and React (or equivalent modern stack) ·         Excellent communication skills and ability to articulate technical trade-offs effectively ·         Experience mentoring engineers and working across multiple layers of the tech stack ·         Bonus: experience with gaming, interactive media, AI-powered consumer applications, or cross-platform products on mobile, smart TVs, or voice assistants Benefits ·         100% coverage of medical, dental, and vision insurance for employees and dependents ·         Company-matched 401(k) plan ·         Flexible hybrid work model with 2-3 in-office days per week (Bay Area) ·         4 weeks of paid time off (with enforced 2-week minimum), 16 paid holidays, 40 hours of bereavement leave, and unlimited sick days ·         Generous parental leave: 24 weeks at 100% pay for birthing parents, 12 weeks at 100% pay for non-birthing parents ·         Visa support for eligible candidates ·         Opportunity to work with a leading AI-powered gaming platform and rapidly growing team Jobgether is a Talent Matching Platform that partners with companies worldwide to efficiently connect top talent with the right opportunities through AI-driven job matching. When you apply, your profile goes through our AI-powered screening process designed to identify top talent efficiently and fairly. 🔍 Our AI evaluates your CV and LinkedIn profile thoroughly, analyzing your skills, experience, and achievements. 📊 It compares your profile to the job’s core requirements and past success factors to determine your match score. 🎯 Based on this analysis, we automatically shortlist the 3 candidates with the highest match to the role. 🧠 When necessary, our human team may perform an additional manual review to ensure no strong profile is missed. The process is transparent, skills-based, and free of bias — focusing solely on your fit for the role. Once the shortlist is completed, we share it directly with the company that owns the job opening. The final decision and next steps (such as interviews or additional assessments) are then made by their internal hiring team. Thank you for your interest!   #LI-CL1
California, USA
Negotiable Salary
Workable
Head of Product Management
Drug Hunter is a B2B subscription knowledge base for biotech/pharma R&D scientists that empowers them to discover the medicines of the future. We’re proud to support teams at 200+ of the world’s leading biotech and pharma companies. Our team is seeking an outstanding Head of Product Management who desires an exciting career challenge building the knowledge platform revolutionizing drug discovery. Our mission is to accelerate innovation in the life sciences by connecting R&D teams with the insights they need to make better, faster decisions. Working closely with a broad stakeholder group and initially reporting to the CEO, you will own the full Drug Hunter Web, Mobile, and Database product lines and supporting platforms. Ideal candidates possess big-picture vision yet the drive and attention to detail to make that vision a reality. You must enjoy spending time with customers and evangelizing their needs. You balance strategic thinking with outstanding execution – holding yourself and the team accountable to delivering successful outcomes. Requirements Primary Responsibilities: Develop strategies and execute plans to drive user engagement, customer acquisition and retention. Operate as a player coach; build, lead, and grow a small team of high-output Product Managers and Designers. Analyze, determine and prioritize target customer, end-user, and internal stakeholder needs. Define and communicate product strategies, goals, and roadmaps aligned with company objectives, supported by business analysis, market research, and customer data. Collaborate with cross-functional stakeholders to build momentum and alignment, and shepherd product concepts through execution, validation and adoption. Ensure appropriate customer research, usability testing and rapid prototyping. Document, validate, prioritize and guide product execution within an Agile development environment. Coordinate go-to-market and post-launch activities. Gather customer feedback to validate that the product meets stated metrics. Prioritize and deliver necessary enhancements. Required Experience and Qualifications: 8+ years in technology product management, with at least 5 years expertise managing consumer, media and/or data products. 3+ years building and managing teams of independent-contributor Product Managers. A Bachelor's degree or equivalent is required. An MBA or advanced degree is desired. Proven track record of full responsibility through the product lifecycle in a fast-paced, start-up/scale-up environment. Has been hands-on shipping highly successful products. Desired, not required (but must be passionate to learn): Experience building products for biotech or pharma audiences and/or background in medicinal chemistry or health sciences. Demonstrable Skills: Leadership. Takes responsibility from inception to outcomes. Determines needs, aligns priorities, delivers to market, measures outcomes, and seeks to build upon success. Customer focused. Deeply understands the market and unmet needs. Loves to create and deliver outstanding products that delight customers and passionate for constant innovation. Highly collaborative. Builds trust and strong cross-functional relationships at all levels, influences without formal authority, pushes back when appropriate, earns respect, and respects the contributions of others. Excellent communicator. Articulates the product strategy and roadmap, structures the problem at hand, experienced and comfortable gaining alignment and in presenting to senior executives. Strategic thinker. Understands business objectives and converts them into clear product plans, follows through with execution. Analytic and results orientated. Uses hard data to assess opportunities, metrics driven, ruthless in prioritization, overcomes obstacles to drive business outcomes. Driven and motivates others. Takes initiative, sets context, identifies options and paths forward, drives for clarity, relentless, hard-working, self-accountable. Understands technology and keeps current with the latest trends. Works with implementation teams to adapt to technical constraints without compromising end-user solutions. Comfortable with ambiguity and challenge. Thrives in a fast-paced environment, concurrently manages multiple initiatives, and remains optimistic. Benefits Drug Hunter takes a market-based approach to pay. The candidate's starting pay will be determined based on job-related skills, experience, qualifications, interview performance, and work location. Total Compensation includes the following: Competitive salary, variable compensation, and equity Broad range of medical, dental, vision, and life insurance plans for employees and their dependents Supplemental insurance including disability, cancer, and critical illness Paid parental leave and childcare FSA plan 401(k) + employer match Home office set up stipend for remote employees Learning and development support Generous and flexible vacation We are an equal opportunity employer, which means we don’t discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We also consider for employment qualified applicants with arrest and conviction records, consistent with applicable federal, state and local law, including but not limited to the San Francisco Fair Chance Ordinance. Please be aware that Drug Hunter will never request personal information, payment, or sensitive details outside of iSolved or via email. All official communications will come from an @drughunter.com email address or from an approved vendor alias.
Burlington, MA, USA
Negotiable Salary
Workable
Senior Cloud Solutions Architect (Azure)
BlueFlag is seeking an ambitious, senior-level Cloud Solutions Architect specializing in Azure to join our dynamic team. This opportunity is remote. As a key player in our cloud infrastructure initiatives, you'll have the opportunity to architect, implement, and optimize cloud solutions for large enterprise environments, including a cutting-edge data and analytics platform for the Department of Veterans Affairs. What You'll Do Lead cloud architecture design and solutioning for a large data and analytics platform, with emphasis on Azure-based services including Azure Databricks, Synapse Analytics, Azure Data Factory, Azure Data Lake Storage Gen2, Azure Kubernetes Service, and Azure Cognitive/ML Services. Drive the migration of large, complex workloads from the legacy warehouses and on-premises VA systems into the cloud-based platform, ensuring security, compliance, and performance optimization. Architect data ingestion, processing, and integration patterns using batch, near-real-time (GoldenGate), streaming (Event Hubs), SFTP, and API-based ingestion methods. Support data preparation, wrangling, transformation, enrichment, normalization, and integration pipelines leveraging Databricks, Synapse, and Starburst. Define and implement solution accelerators (e.g., Databricks notebooks, ingestion patterns, reporting and ML workspace templates) to support repeatable, scalable implementations across workstreams. Partner with customer success teams to support onboarding of VA customers, including migration of workgroups with extensive and complex VM/application footprints. Provide architectural guidance for system-to-system integrations using APIs, SHIR (Self-Hosted Integration Runtime), and various API frameworks. Ensure Identity and Access Management (IAM) and Role-Based Access Control (RBAC) models are consistently applied across Azure Entra (Active Directory), service principals, managed identities, and data lake ACLs. Work closely with platform engineers, data governance engineers, data management engineers, and application development teams to design, review, and improve deployment patterns. Align architecture decisions with VA security and compliance requirements, including FISMA, NIST 800-53, FIPS 199/200, VA Handbook 6500, and the VA Authority to Operate (ATO) boundary constraints. Provide architectural input into platform roadmap planning, ensuring that DevOps, initiatives, and customer projects are aligned with VA’s strategic priorities and capacity planning processes. Document all solution architectures in the platform's unified architecture framework within Confluence, ensuring traceability across enterprise, platform, data, integration, and consumption layers. Mentor engineers, data scientists, and other technical staff in cloud-native architecture best practices, automation, and data product development. Research and evaluate emerging cloud technology trends and best practices to enhance company offerings. Why Join BlueFlag At BlueFlag, we're passionate about leveraging cutting-edge technology to make a real difference. You'll be at the forefront of cloud innovation, working on projects that directly impact people's lives. We offer a high-growth, entrepreneurial environment that values fresh ideas and authentic teamwork. If you're ready to take your cloud engineering career to new heights and contribute to meaningful projects that push the boundaries of technology, we want to hear from you. Join BlueFlag and be part of a team that's shaping the future of cloud solutions! Requirements Education & Experience Bachelor’s degree in Computer Science, Information Systems, or related field. 8+ years of experience in cloud architecture, with at least 5 years focused on Microsoft Azure. Demonstrated experience leading large-scale cloud migration projects, including VM and application migrations from on-premises environments to Azure. Proven expertise in data engineering and analytics workloads, with hands-on experience in: Azure Databricks (data processing, ML pipelines, advanced analytics) Azure Synapse Analytics (SQL Pools, big data analytics, enterprise data warehouse) Azure Data Factory and Event Hubs (batch, near real-time, and streaming ingestion) Azure Data Lake Storage Gen2, Neo4J, and SQL databases Technical Skills Strong background in cloud-native solution architecture within multi-cloud environments (Azure Gov, AWS). Experience with infrastructure-as-code (Terraform, GitHub Actions) for provisioning and deployment automation. Deep understanding of data governance frameworks (Collibra, Immuta for ABAC, RBAC group models in Azure Entra). Knowledge of system security and compliance requirements in a federal environment, including NIST 800-53, FISMA, FedRAMP High, and VA Handbook 6500. Familiarity with disaster recovery, system integrity, and secure communications controls (e.g., Contingency Planning, System and Information Integrity, System and Communications Protection SOPs). Professional Skills Experience leading cross-functional teams (architecture, DevOps, data governance, application development) in a program environment. Strong client engagement skills, with ability to work directly with VA stakeholders, data providers, and consumers to translate business needs into technical solutions. Proven ability to design scalable, secure, and compliant data and analytics solutions that align with organizational strategy and regulatory requirements. Excellent communication skills to support stakeholder engagement, intake processes, and solution handoffs. Certifications (preferred) Microsoft Certified: Azure Solutions Architect Expert Microsoft Certified: Azure Data Engineer Associate or Azure Data Scientist Associate Experience with Azure security certifications (e.g., SC-100, SC-200) is a plus US Citizen: Must be a citizen of the United States. Security Clearance: Must be able to obtain a public trust clearance. Must be eligible to work in the United States. Benefits Competitive salary Generous annual leave and paid holidays Comprehensive group health and dental plans 401(k) with company match Life insurance and AD&D coverage Ongoing training and professional development opportunities
Mt. Juliet, TN, USA
Negotiable Salary
Workable
Technical Support Specialist
The Technical Support Specialist will interact with website events and customer issues in an intuitive, problem-solving manner. You will be responsible for monitoring the availability of 24/7 applications and responding to alerts by either resolving issues or escalating them to the appropriate level in real-time. Expertise is needed to support mobile devices as well as desktops and laptops. We are looking to fill 1 full-time employee for our 3rd shift, and you will be on-call 1 weekend per month, which will accrue PTO. This position requires a tech-savvy person who can predict potential issues and is looking for a career opportunity that is challenging. You will be working with a large team that is responsible for architecting, building, testing, and supporting the site. You may be involved in assisting with some of these efforts. PA state government or other government experience is helpful. This position is associated with a long-term contract with excellent career-building opportunities. This is a work-from-home position. Must be dependable with a proven ability to work without direct supervision. You must reside in the United States. Laptop & communication tools will be provided. Requirements · Website monitoring includes analyzing notifications and alerts for escalation, supporting real-time and scheduled events, and ensuring all automated communications are distributed without error. · Provide support communications for customer issues. · Interface with team leadership to understand daily / weekly roles and responsibilities and provide status updates on all activities daily. · Performs quality assurance (testing) procedures to ensure error-free working products and applications. · Evaluation and analysis of digital program performance and preparation of standardized analytical reports for internal and external purposes. Job Requirements: · Ability to handle multiple tasks with changing priorities. · Ability to work in a fast-paced, deadline-oriented environment. · Shift schedule will be non-traditional working hours, including one weekend a month. · Ability to work independently to complete required tasks without direct support or supervision. · Understands basic user experience/information architecture. · Understanding of website technologies (HTML, CSS, JavaScript). · Content Management System (CMS) Experience preferred. · Ability to think critically to solve problems on the fly. · Strong analytical, prioritizing, interpersonal, problem-solving skills. A clear criminal background is necessary. U.S. permanent residency is required. Benefits 401(k) Dental insurance Health insurance Paid time off Retirement plan Vision insurance STD/LTD Accidental Dismemberment
Pittsburgh, PA, USA
Negotiable Salary
Workable
Product Manager III
Teguar is a leading provider of cutting-edge industrial and medical computer solutions that are specifically designed to provide reliable performance in the most demanding environments and applications. Founded in 2010, we are a fast-growing Inc 5000 company and we believe in excellence in the quality of our products, the quality of our customer service and the quality of our team. We are seeking an experienced Product Manager to lead our fastest - growing Medical market segment. This role will drive the adoption of Teguar's advanced computing hardware in cutting-edge medical applications. SUMMARY: The Product Manager will help customers bring their product visions to life by ensuring Teguar solutions are closely aligned with their needs by understanding each market's needs, owning the product roadmap, and ensuring successful delivery of solutions. DUTIES AND RESPONSIBILITIES: Product Ownership: Gain a deep understanding of current products: performance, customer feedback, challenges, and opportunities. Get hands-on with hardware and software to build technical credibility and documentation. Roadmap & Strategy: Develop and maintain a product roadmap that reflects customer needs, industry shifts, supplier base & availability. Anticipate when to launch new products and when to sunset aging ones. Position products against the competitive landscape to maximize value and differentiation. Influence vendors and internal design projects to bring product to market to address gaps you identify. Create a product vision that brings elegant and rugged products to our customers and excites vendors to align behind our design concepts and bring them to reality. Onboard new partners/vendors if needed to achieve your product vision. Communication & Influence Communicate product plans, requirements, and roadmaps clearly to internal teams and external stakeholders such as customers and vendors. Represent Teguar at key customer meetings, international trade shows , and industry events. Comfortable creating marketing content and able to stay informed on industry specific lingo and tone. Sales Engineering & Support Works closely with sales to gather customer requirements and determine product fit. Communicate information and concepts to customers at their level of technical understanding. Successfully guide customers to mutually beneficial outcomes for them and for us. Be comfortable running critical meetings with customers on technical topics independently. Team Empowerment Share learnings, mentor peers, and foster collaboration within the entire company. Act as a knowledge resource to Product Specialists and Application engineers, developing their product expertise and enabling them to effectively support sales and customers. Directly manage a team within your verticals and assign tasks effectively to all in the department. Market & Financial Analysis Analyze market data and customer input to guide product decisions. Weigh multiple factors and provide sound judgement on when to lower margins to win deals or succeed in a new market/sector. Fully accountable for the profitability of assigned product lines. QUALIFICATIONS: Bachelor's Degree from four-year college or university and 6 years' relevant experience; or a minimum 9 years of experience in lieu of education, or an equivalent combination of education and experience. Requirements Experience in the medical industry or direct knowledge of medical electrical safety testing (IEC 60601-1-2). Direct experience leading and launching new technical products in a B2B market. Prior experience communicating with global Vendors a must. Knowledge of some of the latest technology used in computers such as display & touchscreen technology, wireless, common input/outputs, CPU, Storage, Memory A true passion for learning about and leveraging new technology Prior experience leading a team is a plus. Benefits 401K matching HRA (Health Reimbursement Account) covers medical, dental and vision expenses Gym membership Paid Holidays and PTO days Birthday PTO and Volunteer Day Culture Committee Program Employee Referral Bonus Program Modern office work environment with free drinks and snacks
Charlotte, NC, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.