Web Scraping Data Engineer

at Transform Solutions (P) Limited

DP
Posted by sowmiya Venkat
icon
Surat
icon
3 - 5 yrs
icon
₹3L - ₹7L / yr
icon
Full time
Skills
Javascript
Python
Selenium
Web Scraping
HTML/CSS
XPath
  • Design, build web crawlers to scrape data and URLs.
  • Integrate the data crawled and scraped into our databases
  • Create more/better ways to crawl relevant information
  • Strong knowledge of web technologies (HTML, CSS, Javascript, XPath, Regex)
  • Understanding of data privacy policies (esp. GDPR) and personally identifiable information
  • Develop automated and reusable routines for extracting information from various data sources
  • Prepare requirement summary and re-confirm with Operation team
  • Translate business requirements into specific solutions
  • Ability to relay technical information to non-technical users
  • Demonstrate Effective problem solving and analytical skill
  • Ability to pay attention to detail, pro-active, critical thinking and accuracy is essential
  • Ability to work to deadlines and give realistic estimates

    

 

Skills & Expertise

  • 2+ years of web scraping experience
  • Experience with two or more of the following web scraping frameworks and tools: Selenium, Scrapy, Import.io, Webhose.io, ScrapingHub, ParseHub, Phantombuster, Octoparse, Puppeter, etc.
  • Basic knowledge of data engineering (database ingestion, ETL, etc.) 
  • Solution orientation and "can do" attitude - with a desire to tackle complex problems.

About Transform Solutions (P) Limited

TransForm Solutions is an International BPO company with world-class execution offering global clients customized services and exceptional customer engagement since 2002.

We have evolved to provide a wide range of operations and back-office services since then, for companies all over the world (including Fortune 500s) in industries as diverse as consulting, financial services, eCommerce, education, logistics and real estate.

Founded
2002
Type
Services
Size
20-100 employees
Stage
Profitable
View full company details
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
2101133
Matches delivered
3712187
Network size
15000
Companies hiring

Similar jobs

Web Designer

at Nativebyte Softwares LLP

Founded 2016  •  Products & Services  •  20-100 employees  •  Bootstrapped
HTML/CSS
Adobe Photoshop
Adobe Illustrator
User Interface (UI) Design
User Experience (UX) Design
icon
Remote only
icon
1 - 3 yrs
icon
₹1L - ₹3L / yr
We are looking for a UI/UX Designer to turn our software into easy-to-use products for our clients.
UI/UX Designer responsibilities include gathering user requirements, designing graphic elements and building navigation components. To be successful in this role, you should have experience with design software and wireframe tools. If you also have a portfolio of professional design projects that includes work with web/mobile applications, we’d like to meet you.
Ultimately, you’ll create both functional and appealing features that address our clients’ needs and help us grow our customer base.

Responsibilities:-

  1. Gather and evaluate user requirements in collaboration with product managers and engineers
  2. Illustrate design ideas using storyboards, process flows and sitemaps
  3. Design graphic user interface elements, like menus, tabs and widgets
  4. Build page navigation buttons and search fields
  5. Develop UI mockups and prototypes that clearly illustrate how sites function and look like
  6. Create original graphic designs (e.g. images, sketches and tables)
  7. Prepare and present rough drafts to internal teams and key stakeholders
  8. Identify and troubleshoot UX problems (e.g. responsiveness)
  9. Conduct layout adjustments based on user feedback
  10. Adhere to style standards on fonts, colors and images.

Key Skills:-
  1. UI/UX Designer, Portfolio of design projects,HTML,CSS
  2. Knowledge of wireframe tools (e.g. Wireframe.cc and InVision)
  3. Up-to-date knowledge of design software like Adobe Illustrator and Photoshop
  4. Team spirit; strong communication skills to collaborate with various stakeholders
  5. Good time-management skills
Job posted by
Nikita Ogale

Analytics

at ProGrad

Founded 2018  •  Services  •  20-100 employees  •  Profitable
Python
Java
Tableau
SQL
PowerBI
icon
Chennai
icon
1 - 4 yrs
icon
₹3L - ₹8L / yr
Company Name: LatentView Analytics

Job Summary :


Independently handle the delivery of analytics assignments by mentoring a team of 3 - 10 people and delivering to exceed client expectations

Responsibilities :

- Co-ordinate with onsite company consultants to ensure high quality, on-time delivery

- Take responsibility for technical skill-building within the organization (training, process definition, research of new tools and techniques etc.)

- Take part in organizational development activities to take company to the next level

Qualification, Skills & Prior Work Experience :

- Great analytical skills, detail-oriented approach

- Sound knowledge in MS Office tools like Excel, Power Point and data visualization tools like Tableau, PowerBI or such tools

- Strong experience in SQL, Python, SAS, SPSS, Statistica, R, MATLAB or such tools would be preferable

- Ability to adapt and thrive in the fast-paced environment that young companies operate in

- Priority for people with analytics work experience

- Programming skills- Java/Python/SQL/OOPS based programming knowledge

Job Location : Chennai, Work from Home will be provided until COVID situation improves

Note :

- Minimum one year experience needed

- Only 2019, 2020 and 2020 passed outs applicable

- Only above 70% aggregate throughout studies is applicable

- POST GRADUATION is must
Job posted by
Heruba C

Javascript Engineer

at Cloud infrastructure solutions and support company. (SE1)

Agency job
via Multi Recruit
Javascript
HTML/CSS
React.js
icon
Bengaluru (Bangalore)
icon
3 - 6 yrs
icon
₹6L - ₹8L / yr
  • 3-6 years of experience as a full-stack developer, with solid understanding of JavaScript, HTML, CSS, NodeJS.
  • Ability to write pure JavaScript code without relying on third-party libraries.
  • Proficiency in browser rendering behavior, memory management, and performance.
  • Exposure to build & process tools like Grunt, Gulp, WebPack, Node, NPM.
  • Familiarity with push notifications, REST APIs and cloud messaging.
  • Experience with Bootstrap, Electron, React, Angular is a plus.
  • Knowledge of VoIP(Voice Over IP), WebRTC is a plus.
  • Preferred to have experience working with AWS components (EC2, S3, SNS, CDN, Lambda).
  • Working knowledge of Git and proficiency with at least one build server(Jenkins/Travis/CircleCI).

 

 

 

Job posted by
Paramesh P

Oracle Forms and Reports

at Doyen Systems Private Limited

Founded 2006  •  Services  •  100-1000 employees  •  Profitable
Oracle Forms
Oracle Reports
PL/SQL
Oracle
Javascript
React.js
icon
Remote, Chennai, Tiruchirappalli, Coimbatore
icon
4 - 10 yrs
icon
₹1L - ₹9L / yr
  • Strong Knowledge in Oracle Forms and Reports
  • Should be familiar with various triggers, events , canvas, master child forms, record groups , build-ins, properties etc., in Forms and reports
  • Strong Knowledge in SQL / PLSQL concepts
  • Strong in Analytical and Aggregate functions
  • Strong in writing Procedure / Function / Packages
  • Strong knowledge in the user of Cursors / Collections / Exception handling
  • Strong in Datatypes, Constrainsts , index
  • Having exposure to JavaScript and ReactJS will be an added advantage
Job posted by
Chithra S

Credit Risk Analyst

at Niro

Founded 2021  •  Product  •  20-100 employees  •  Raised funding
Risk assessment
Risk Management
Risk analysis
Python
SAS
SPSS
R
icon
Bengaluru (Bangalore)
icon
2 - 4 yrs
icon
₹7L - ₹15L / yr
  • Gather information from multiple data sources make Approval Decisions mechanically
  • Read and interpret credit related information to the borrowers
  • Interpret, analyze and assess all forms of complex information
  • Embark on risk assessment analysis
  • Maintain the credit exposure of the company within certain risk level with set limit in mind
  • Build strategies to minimize risk and increase approval rates
  • Design Champion and Challenger tests, implement and read test results
  • Build Line assignment strategies
Skills required:
- Credit Risk Modeling
- Statistical Data Understanding and interpretation
- Basic Regression and Advanced Machine Learning Models
- Conversant with coding on Python using libraries like Sklearn etc.
- Build and understand decision trees
Job posted by
Vinay Gurram

BigData Developer (Spark+Python)

at Simplifai Cognitive Solutions Pvt Ltd

Founded 2017  •  Product  •  100-500 employees  •  Bootstrapped
Spark
Big Data
Apache Spark
Python
PySpark
Hadoop
icon
Pune
icon
2 - 15 yrs
icon
₹10L - ₹30L / yr

We are looking for a skilled Senior/Lead Bigdata Engineer to join our team. The role is part of the research and development team, where you with enthusiasm and knowledge are going to be our technical evangelist for the development of our inspection technology and products.

 

At Elop we are developing product lines for sustainable infrastructure management using our own patented technology for ultrasound scanners and combine this with other sources to see holistic overview of the concrete structure. At Elop we will provide you with world-class colleagues highly motivated to position the company as an international standard of structural health monitoring. With the right character you will be professionally challenged and developed.

This position requires travel to Norway.

 

Elop is sister company of Simplifai and co-located together in all geographic locations.

https://elop.no/

https://www.simplifai.ai/en/


Roles and Responsibilities

  • Define technical scope and objectives through research and participation in requirements gathering and definition of processes
  • Ingest and Process data from data sources (Elop Scanner) in raw format into Big Data ecosystem
  • Realtime data feed processing using Big Data ecosystem
  • Design, review, implement and optimize data transformation processes in Big Data ecosystem
  • Test and prototype new data integration/processing tools, techniques and methodologies
  • Conversion of MATLAB code into Python/C/C++.
  • Participate in overall test planning for the application integrations, functional areas and projects.
  • Work with cross functional teams in an Agile/Scrum environment to ensure a quality product is delivered.

Desired Candidate Profile

  • Bachelor's degree in Statistics, Computer or equivalent
  • 7+ years of experience in Big Data ecosystem, especially Spark, Kafka, Hadoop, HBase.
  • 7+ years of hands-on experience in Python/Scala is a must.
  • Experience in architecting the big data application is needed.
  • Excellent analytical and problem solving skills
  • Strong understanding of data analytics and data visualization, and must be able to help development team with visualization of data.
  • Experience with signal processing is plus.
  • Experience in working on client server architecture is plus.
  • Knowledge about database technologies like RDBMS, Graph DB, Document DB, Apache Cassandra, OpenTSDB
  • Good communication skills, written and oral, in English

We can Offer

  • An everyday life with exciting and challenging tasks with the development of socially beneficial solutions
  • Be a part of companys research and Development team to create unique and innovative products
  • Colleagues with world-class expertise, and an organization that has ambitions and is highly motivated to position the company as an international player in maintenance support and monitoring of critical infrastructure!
  • Good working environment with skilled and committed colleagues an organization with short decision paths.
  • Professional challenges and development
Job posted by
Priyanka Malani

Data Engineer

at Our client company is into Analytics. (RF1)

Agency job
via Multi Recruit
Data Engineer
Big Data
Python
Amazon Web Services (AWS)
SQL
Java
ETL
icon
Bengaluru (Bangalore)
icon
3 - 5 yrs
icon
₹12L - ₹14L / yr
  •  We are looking for a Data Engineer with 3-5 years experience in Python, SQL, AWS (EC2, S3, Elastic Beanstalk, API Gateway), and Java.
  • The applicant must be able to perform Data Mapping (data type conversion, schema harmonization) using Python, SQL, and Java.
  • The applicant must be familiar with and have programmed ETL interfaces (OAUTH, REST API, ODBC) using the same languages.
  • The company is looking for someone who shows an eagerness to learn and who asks concise questions when communicating with teammates.
Job posted by
Ragul Ragul

QA Analyst

at Searce Inc

Founded 2004  •  Products & Services  •  100-1000 employees  •  Profitable
Software Testing (QA)
Test Automation (QA)
QA management
Functional testing
Integration testing
Regression Testing
System testing
Javascript
Amazon Web Services (AWS)
automated too
icon
Bengaluru (Bangalore)
icon
3 - 7 yrs
icon
₹10L - ₹12L / yr


Job Description

QA Analyst | Bengaluru



Quality is everyone’s responsibility...and at Searce we do it right! 

If you feel the same way, come along! 



Job Title: QA Analyst

What are we looking for?

If your biggest pet peeve is ignoring flaws and biggest strength is having an impeccable eye for detail, then you are a QA Analyst at heart. As a QA Analyst you will play a major role in building excellent products. You will work efficiently and closely with software developers and managers to smoothen and improve the quality of the final  product. If you recognize your own natural skill set in the things mentioned above – that’s a sign you will do well in this field and help grow with Searce.

Being a QA Analyst, you will be responsible for designing and writing programs that run automated tests on new or existing software products – an essential part of the software development cycle. You will be required to use  automation frameworks (standardised guidelines) to build these programs on and write test scripts that do the testing. Different test automation developers specialise in particular automation tools, such as Selenium.

  • Natural creativity:

The best recruiters are creative visionaries, people who are capable of stepping back, seeing the big picture, and coming up with new ways of approaching challenges and making positive changes to how the company is managed and marketed.

  • Not a CAVEr: 

You are a person that people like to be around. You are not a CAVE (Constantly Against Virtually Everything) personality.

  • Say no to HiPPO: 

At Searce, we want people who value everyone’s opinions & perspectives. We don’t want them to get overpowered by HiPPO (Highest Paid Person’s Opinion)

 

Major Roles & Responsibilities 

  1. Plan, develop and execute tests/QA use cases against all the product releases using a variety of manual and automated test tools to ensure requirements have been met. 
  2. Working closely with a team of test engineers to define Test Strategy, Test Plan, Test Methodologies.
  3. Work with the development team to ensure all requirements have been tested, defects have been identified and documented, impacts have been assessed, and resolutions provided. 
  4. Create and maintain test documentation such as test plans and test reports.
  5.  Interact with team members and other groups to troubleshoot and resolve quality defects and issues identified during the testing process and post-release of the product. 
  6. Communicate product and process information to other members of the QA team, other departments as necessary. 
  7.  Create Automation suites for existing test cases to reduce manual effort. 
  8. Ability to find errors and communicate them timely.

Education & Experience

Is Education overrated? Yes. We believe so. But there is no way to locate you otherwise. So we might look for at least a Bachelor’s degree in Engineering (Computer Science).

  1.  Or else, you should be programming from 12. For us, the latter is better as it shows you have a programming mindset. We will find you faster if you specify the latter in some manner. :) 
  2. Relevant years of experience in different types of testing that includes Functional testing, Integration testing, Regression testing, System testing, Installation & upgrade testing, and sanity/smoke testing, preferably in a similar industry. 
  3. Familiarity and skill with the tools of the trade in core & Advance Java,web Automation Testing,Automation Framework implementation and understanding such Keyword, hybrid etc 
  4. Experience with Agile software development methodologies. 
  5. Strong written and verbal communications demonstrated through the creation of test plans, defect documentation, and summary presentations. 
  6. Ability to leverage technology to advance the quality of products and efficiency of development and quality related processes. 
  7. Should be able to work from scratch, creating a framework.

Are you the one? Quick Fit test:

  1. Love for cloud: When was the last time your dinner entailed an act on “How would ‘Jerry Seinfeld’ pitch Cloud platform & products to this prospect” and your friends ended up doing the comical  ‘Sheldon’ version of the same thing
  2. Passion for sales: When was the last time you went to a remote gas station while on vacation, and ended up helping the gas station owner saasify his 7 gas stations across other geographies? 
  1. Compassion for customers: Your listening skills are impeccable, but so are your speaking skills. And when you speak, you take command of the entire room! 
  1. Humor for life: When was the last time you told a concerned CEO, ‘If Elon Musk can attempt to take humanity to Mars, why can’t we take your business to run on the cloud?’

 

About Searce

What is ‘searce’

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’. It signifies our way of working: To improve to the finest degree of excellence, ‘solving for better’ every time. Searcians are passionate improvers & solvers who love to question the status quo.

The primary purpose of all of us, at Searce, is driving intelligent, impactful & futuristic business outcomes using new-age technology. This purpose is driven passionately by HAPPIER people who aim to become better, everyday.

What we do

Searce is a modern tech consulting firm that empowers clients to futurify their businesses, leveraging Cloud, AI & Analytics.

  1. We are a category defining niche’ cloud-native technology consulting company, specializing in modernizing (improve, automate & transform) the full-scope of infra, app, process & work
  2. We partner with clients in their ‘beyond x’ journey to drive intelligent, impactful & futuristic business outcomes
  3. We are the most preferred tech partner of choice when it comes to ‘solving for better’ for the new-age tech startups & digital enterprises, leading disruption in their industries
  4. Our Service Offerings: We offer Advanced Cloud, Data & App Modernization, Cloud Consulting, Management & Improvement (DevOps, SysOps & Cloud Managed Services), Applied AI & Analytics services 
  5. As one of the top 5 niche’ full scope global partners for Google Cloud & a preferred partner for AWS, we are the most preferred ‘engineering-led’ tech company of choice when it comes to solving complex business problems

Who we are

We are passionate improvers, solvers & futurists. Driven by our engineering excellence mindset, we care most about delivering intelligent, impactful & futuristic business outcomes. Searcians are motivated by continuous improvement & solving for better in everything we do.

At the core, a Searcian is self-driven to become better, everyday. In passionate pursuit of the finest degree of excellence we drive exceptional outcomes in everything we do.

We believe that trust is the most important value. We also believe that we need to ‘earn the trust’, everytime one engages with us. And earning trust for us is far more important than anything else. We aim to be the *most trusted* tech consulting partner for our clients.

We are HAPPIER at heart. Humble, Adaptable, Positive, Passionate, Innovative, Excellence focused, & Responsible. We live the HAPPIER Culture Code.

Being HAPPIER.

How we work

  1. Customers. Partners. Our aim is to build relationships with customers for life. And meaningfully improve the life of every customer.
  2. We do what we say. We say what we do. We are uncomfortably honest and transparent. Being genuine wins trust & makes people happier.
  3. Mistakes are encouraged. We make mistakes. Tons of those. Everyday. And we don’t mind apologizing to our juniors, peers or superiors. We are no ego-doers.
  4. Underpromise. Overdeliver. We work with a deep desire to go above and beyond in everything we do. Everytime.

So, If you are passionate about tech, future & what you read above (we really are!), apply here to experience the ‘Art of Possible

Job posted by
Eisha Dewarwal

Data Engineer

at Japan Based Leading Company

Agency job
via Bleuming Technology
Big Data
Amazon Web Services (AWS)
Java
Python
MySQL
DevOps
Hadoop
icon
Bengaluru (Bangalore)
icon
3 - 10 yrs
icon
₹0L - ₹20L / yr
A data engineer with AWS Cloud infrastructure experience to join our Big Data Operations team. This role will provide advanced operations support, contribute to automation and system improvements, and work directly with enterprise customers to provide excellent customer service.
The candidate,
1. Must have a very good hands-on technical experience of 3+ years with JAVA or Python
2. Working experience and good understanding of AWS Cloud; Advanced experience with IAM policy and role management
3. Infrastructure Operations: 5+ years supporting systems infrastructure operations, upgrades, deployments using Terraform, and monitoring
4. Hadoop: Experience with Hadoop (Hive, Spark, Sqoop) and / or AWS EMR
5. Knowledge on PostgreSQL/MySQL/Dynamo DB backend operations
6. DevOps: Experience with DevOps automation - Orchestration/Configuration Management and CI/CD tools (Jenkins)
7. Version Control: Working experience with one or more version control platforms like GitHub or GitLab
8. Knowledge on AWS Quick sight reporting
9. Monitoring: Hands on experience with monitoring tools such as AWS CloudWatch, AWS CloudTrail, Datadog and Elastic Search
10. Networking: Working knowledge of TCP/IP networking, SMTP, HTTP, load-balancers (ELB) and high availability architecture
11. Security: Experience implementing role-based security, including AD integration, security policies, and auditing in a Linux/Hadoop/AWS environment. Familiar with penetration testing and scan tools for remediation of security vulnerabilities.
12. Demonstrated successful experience learning new technologies quickly
WHAT WILL BE THE ROLES AND RESPONSIBILITIES?
1. Create procedures/run books for operational and security aspects of AWS platform
2. Improve AWS infrastructure by developing and enhancing automation methods
3. Provide advanced business and engineering support services to end users
4. Lead other admins and platform engineers through design and implementation decisions to achieve balance between strategic design and tactical needs
5. Research and deploy new tools and frameworks to build a sustainable big data platform
6. Assist with creating programs for training and onboarding for new end users
7. Lead Agile/Kanban workflows and team process work
8. Troubleshoot issues to resolve problems
9. Provide status updates to Operations product owner and stakeholders
10. Track all details in the issue tracking system (JIRA)
11. Provide issue review and triage problems for new service/support requests
12. Use DevOps automation tools, including Jenkins build jobs
13. Fulfil any ad-hoc data or report request queries from different functional groups
Job posted by
Ameem Iqubal

Data Engineer

at Largest Analytical firm

Agency job
via Xpheno
Hadoop
Big Data
Spark
Scala
Python
PySpark
SQL
icon
Bengaluru (Bangalore)
icon
4 - 14 yrs
icon
₹10L - ₹28L / yr

·        Advanced Spark Programming Skills

·        Advanced Python Skills

·        Data Engineering ETL and ELT Skills

·        Expertise on Streaming data

·        Experience in Hadoop eco system

·        Basic understanding of Cloud Platforms

·        Technical Design Skills, Alternative approaches

·        Hands on expertise on writing UDF’s

·        Hands on expertise on streaming data ingestion

·        Be able to independently tune spark scripts

·        Advanced Debugging skills & Large Volume data handling.

·        Independently breakdown and plan technical Tasks

Job posted by
Ashok P
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Get to hear about interesting companies hiring right now
iconFollow Cutshort
Want to apply to this role at Transform Solutions (P) Limited?
Why apply via Cutshort?
Connect with actual hiring teams and get their fast response. No spam.
Learn more
Get to hear about interesting companies hiring right now
iconFollow Cutshort