Build a production-ready web crawling and AI lead-qualification application: crawl and extract website content, analyze with LLMs to score/qualify industry-specific leads, produce structured outputs, and deliver a maintainable handover-ready product.
This is a remote position.
MENA Alliances is hiring a Web Crawling & AI Lead Qualification Engineer to develop a smart tool that identifies and evaluates potential business leads.
In this role, you will build a web crawling and AI-powered lead qualification application that takes a list of company websites, extracts relevant content, and uses AI to determine whether those companies are strong marketing targets for specific industry sectors (such as utilities or telecom).
The final deliverable should be a clean, maintainable, and handover-ready product that the end client can easily operate and expand.
- Develop a web crawling and scraping system to collect relevant data from a list of websites.
- Extract and process meaningful content from crawled pages.
- Integrate AI/LLM capabilities to analyze website content and evaluate whether the company fits a target industry vertical.
- Design a scoring or ranking mechanism that qualifies and prioritizes leads.
- Produce a structured output containing qualified leads with clear reasoning or scoring.
- Deliver a standalone, well-structured application ready for handover to the client.
RequirementsTechnical Requirements
- Experience with web scraping and crawling tools such as BeautifulSoup, Scrapy, Playwright, Puppeteer, or similar frameworks.
- Strong knowledge of content extraction and text analysis.
- Hands-on experience integrating AI / LLM APIs (e.g., OpenAI, Anthropic, or open-source models).
- Ability to design and build clean, maintainable software products, not just quick prototypes.
- Familiarity with modern development stacks and best practices.
- Experience in lead generation, marketing technology, or sales intelligence tools.
- Knowledge of prompt engineering, particularly for multilingual or non-English content.
- Experience building end-to-end AI-powered tools or automation solutions.
- German language skills are a plus but not required (language support will be provided by the client).
Benefits
Similar Jobs
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead product strategy and delivery for Mastercard's In Control virtual card platform. Translate business requirements into technical specs, work with engineering scrum teams, engage regional partners and customers, define platform vision for tokenized and virtual card payments, validate technical delivery, and drive go-to-market and product enhancements to grow B2B and T&E payment adoption.
Top Skills:
AgilePayment ProcessingPme FrameworkScrumTokenizationUx/UiVirtual Card Platform
Cloud • Security • Software • Cybersecurity • Automation
Conduct advanced application security research across GitLab’s DevSecOps and AI-powered platforms. Identify and exploit novel, systemic, and chained vulnerabilities; develop proof-of-concept exploits, testing methodologies, and research automation; assess AI attack vectors and open-source dependencies; drive remediation and security improvements; advise engineering teams, contribute to roadmaps, mentor researchers, and share findings with the security community.
Top Skills:
Duo Agent PlatformGitlabGitlab DuoGoPythonRubyRustTypescript
Cloud • Security • Software • Cybersecurity • Automation
Conducts advanced application security research across GitLab’s DevSecOps and AI-powered platforms. Responsibilities include discovering and exploiting systemic vulnerabilities, penetration testing, developing proof-of-concept exploits, researching AI and agentic security threats, building automated research tooling, coordinating remediation, mentoring security professionals, and communicating findings to engineering and security communities.
Top Skills:
Ai FrameworksDevsecopsDuo Agent PlatformGitlabGitlab Duo ChatGoPythonRubyRustTypescript
What you need to know about the Edinburgh Tech Scene
From traditional pubs and centuries-old universities to sleek shopping malls and glass-paneled office buildings, Edinburgh's architecture reflects its unique blend of history and modernity. But the fusion of past and future isn't just visible in its buildings; it's also shaping the city's economy. Named the United Kingdom's leading technology ecosystem outside of London, Edinburgh plays host to major global companies like Apple and Adobe, as well as a growing number of innovative startups in fields like cybersecurity, finance and healthcare.
