Cutshort logo
Thoughtworks logo
Lead Consultant: Data Engineer
Lead Consultant: Data Engineer
Thoughtworks's logo

Lead Consultant: Data Engineer

Vidyashree Kulkarni's profile picture
Posted by Vidyashree Kulkarni
9 - 15 yrs
Best in industry
Remote only
Skills
Spark
Hadoop
Big Data
Data engineering
PySpark
skill iconScala
Data Structures
Data modeling
Data security
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

Job responsibilities
  • You will partner with teammates to create complex data processing pipelines in order to solve our clients' most complex challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy, support and operate data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches
  • Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
  • Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications

Technical skills

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
  • Professional skills
  • You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
  • An interest in coaching, sharing your experience and knowledge with teammates
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed
  • Presence in the external tech community: you willingly share your expertise with others via speaking engagements, contributions to open source, blogs and more
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Thoughtworks

Founded :
1993
Type :
Products & Services
Size :
5000+
Stage :
Profitable

About

Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.

 

Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.


Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.

 

As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.

Read more

Company video

Thoughtworks's video section
Thoughtworks's video section

Connect with the team

Profile picture
Yogita Singh
Profile picture
Apoorv Singhal
Profile picture
Santhosh Joshua
Profile picture
Vidyashree Kulkarni
Profile picture
Sana Singh
Profile picture
Nargise Manova
Profile picture
Ranjith Prabhu
Profile picture
M I Shifa Samrin
Profile picture
Valarmathi M
Profile picture
Anubhuti Pundir
Profile picture
Abhidev Gwari
Profile picture
Diksha Kalucha
Profile picture
Ramya S
Profile picture
Logeshwaran M
Profile picture
Sukriti Sharma
Profile picture
Megha Wadhwa
Profile picture
Jyoti Deswal
Profile picture
Anugrah Mathur
Profile picture
Aaliya Thaver
Profile picture
Aasif Syed
Profile picture
Maria Nancy
Profile picture
Neha Sharma
Profile picture
Charani GP
Profile picture
Ambica Bharadwaj
Profile picture
pavan Juluri
Profile picture
nadeem Shaikh
Juana Fernandes
icon
Connect

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Ongrid
Yukta Jain
Posted by Yukta Jain
Gurugram
3 - 7 yrs
₹8L - ₹15L / yr
ISO/IEC 27001:2005
GDPR guidelines
Risk assessment
Internal audit

About OnGrid


OnGrid is a leading digital trust platform offering digital KYC, verifications, and background checks for onboarding employees, contractors users, merchants, customers, etc. Founded by IIT-B alumni, OnGrid has completed more than 500+ million checks across 3000+ happy clients


At OnGrid, we are focused on redefining and reimagining trust, safety, compliance, and accountability through our platforms OnGrid, eLockr, and Gridlines. Having built these basic pillars of trust (and creating a profitable venture with 400+ full-time people in the process), we now want our imagination to be let loose think of avenues never explored, and execute in ways never implemented before.


In this pursuit, we are looking for a motivated Information Security Analyst who is a self-starter, has an eye for detail, is analytical in approach, loves solving problems, and someone who can take initiative to build and improve the company’s information security, identify risks and act on the required changes quickly.


What you will do:

  • Develop efficient strategies to protect the system, the networking infrastructure, data, and information systems against potential threats/cyber risks
  • Routinely performing threat analysis, system checks, and security tests
  • Defining and updating information security criteria and validation procedures
  • Effectively discuss to understand safety and security and fix the problems along with different stakeholders
  • To be a security representative or point of contact for all technical deliveries, initiatives, and project implementations.
  • To develop technical processes and procedures and promote compliance in line with regulations, corporate policies, or standards as per ISO27001
  • Assess technical security risks in terms of impact on systems and service confidentiality, integrity, and availability, and report and escalate results of risk assessments.
  • Report any real or potential security breaches/vulnerabilities to various stakeholders and provide technical support during incident response
  • Monitor security tools to detect security events & incidents Report and escalate any security breaches to the Information Technology Security Officer
  • Operate vulnerability scanning and compliance tools to identify system weaknesses
  • Represent IT Security matters at technical and business forums


Requirements: 

  • 5+ years of relevant experience in the information security field.
  • Team handling/Mentoring experience
  • Relevant experience working with ISO Policies, and GDPR guidelines.
  • Strong knowledge of network architecture and security concepts related to routing
  • Exceptional attention to detail
  • Excellent analytical and problem-solving skills
  • Great team player and able to work efficiently with minimal supervision
  • Excellent communication skills, both written and verbal, work with the different stakeholders on strengthening the security risks
  • Able to handle and cope with stressful situations and understand the pressures of a start-up environment


What we offer:

Our team practices agile methodologies and the communication channel with the team lead is always open. Teammates are encouraged to bring their ideas forward ensuring the team’s overall development and we provide the best of facilities in terms of infrastructure and other benefits such as paid holidays, maternity and paternity leave, health insurance, flexible work hours, and many more. Our teams are close-knit and often contribute to each other’s professional and personal growth.




Read more
IBS Business School
IBS Business School
Agency job
Nagpur
1 - 2 yrs
₹1L - ₹4L / yr
Educational technology
Business Development
Client Management
Client Servicing

Salary: Negotiable depending on experience, last salary and interview (20k - 35k) + Local conveyance + Mobile bill + Incentives  


Qualifications & Skills Required for MO and Sr. MO positions:

  • Graduation is a must.
  • Preference will be given to candidates from the Education or service sector. Candidates from other sectors can also be considered if they are willing to work in the Education sector.
  • Candidates should have good communication and a Go-getter attitude.
  • Must have worked upon targets and should be able to meet business revenue.
  • 1-2 years of experience in sales and marketing. Freshers with the required skill set can also be considered.


Read more
Spry Healthcare
Palka Sethi
Posted by Palka Sethi
Pune
2 - 4 yrs
₹15L - ₹25L / yr
Product Management
us healthcare
API
Business Analysis
SaaS
+4 more
Location - Pune (Work from Office)
Experience - 4 – 6 years
About the role –
The Product Manager role will report to the CEO and will build the product from 0 to 1.
Responsibilities
 Need to work with the senior management team to work on product roadmap
 Work with tech and management to create and execute product pipeline
 Own the successful delivery of your roadmap and co-own the success of the overall products
 Define requirements (JIRA) - Creating EPICs, user stories. Tracking the sprint
 Effectively identify and manage cross-team dependencies
 Ensure delivery timelines

Required Knowledge and Skills

 Should have good understanding of eligibility, Prior authorization workflows
 worked as product lead/lead BA
 Worked on eligibility implementation (API Integration) ( Waystar, Change healthcare, Claim MD etc.)
 Should have experience in building and scaling SaaS tools from the ground up.
 Excellent communication and collaboration skills
 Use common tools to create mockups, stories, and roadmaps Preferred Qualifications
 3+ Years of product management experience, including cloud/SaaS product

US Healthcare Experience

 Value added - If worked on X12 270, 271

Basic Qualifications
 Bachelor’s engineering degree from Tier 1 institute
 MBA from Tier 1 (good to have)
 3 Years of product management experience, including cloud/SaaS product
Read more
JKSOL INFOTECH
at JKSOL INFOTECH
1 recruiter
Nikita Kapadia
Posted by Nikita Kapadia
Surat, utran
1 - 4 yrs
₹1L - ₹4L / yr
skill iconiOS App Development
skill iconObjective C
skill iconSwift
Xcode
Experience: 6 months to 3 year

Perks and Benefits :
No Bond
Leave Benefits/encashment
Monthly Activities
Flexible time
Friendly workplace

Desired Skills and Experience

ios, JSON, Xcode, https, iPad, interface builder, service integration, xml parsing, ar, xml, max, API, vim, video, cocoa, uikit, iPhone, SQLite, iCloud, backend

Salary: Based on Candidate Experience and expertise
#NoBarForRightCandidate

Location: #Surat Local candidates preferable first.
Read more
Pocket FM
at Pocket FM
1 recruiter
Agency job
Bengaluru (Bangalore)
2 - 5 yrs
₹10L - ₹18L / yr
skill iconiOS App Development
skill iconAndroid Development
Mobile App Development
Pocket FM is an audiobook platform for Indian Languages. We believe Listening is the new Reading and is on a mission to enrich the lives of people through the power of stories and knowledge in the books. (Audio is a $15B+ industry globally with unicorns like Audible, Ximalaya FM, China Literature,Spotify etc)
Founded by IIT Kharagpur and Kanpur alumni, Pocket FM has grown to 2M+ users with deep engagement of 90 minutes time spent per user per day. We are a Series A funded start-up backed by some of the marquee investors like Tencent, Lightspeed, and others.
Who you are
 2-5 Years of experience in product development with expertise in designing and implementing high-performance applications for mobile (Android, iOS).
 Proficiency in Problem Solving and Data structures.
 Expert understanding of iOS and Android native platforms and corresponding frameworks is a must.
 Proficient in Design patterns and principles.
 Amazing debugging skills with the ability to write unit test cases.
 Good communication and interpersonal skills & focus on quality & velocity
Read more
Product based Organization
Product based Organization
Agency job
via Diverse Lynx by Kalpana Sati
Remote, Bengaluru (Bangalore)
3 - 5 yrs
₹4L - ₹9L / yr
Mainframe
OPC
Batch file
JConsole
MVS
+5 more
We are looking for below skills and also someone who are currently in Bangalore Location Only.

Skill Set:

1) Someone who  had worked on Mainframe Operations(Console /Batch).
2) Must have worked on OPC tools.
3) Exposure in batch process, console monitoring etc.
4) Aware of  START, STOP, MVS, IPL PROCESS, etc
Read more
iii Consulting Private Limited
swathanthra daduvai
Posted by swathanthra daduvai
Hyderabad
3 - 5 yrs
₹6L - ₹10L / yr
skill iconJavascript
skill iconHTML/CSS
skill iconPHP
skill iconPython
skill iconRuby on Rails (ROR)
+3 more
Who We Are iii Consulting Pvt. Ltd. is a startup studio founded in 2015 with an aim to spearhead the growth of the Indian startup ecosystem, the three i s that we stand for are Ideate, Incubate and Incorporate. We help organizations to leverage latest technology to help grow their businesses. Senior Backend Developer Job Description We are looking for an experienced Back-end developer to join our tech team. You will be responsible for the server side of our web applications. If you have excellent programming skills and a passion for developing applications or improving existing ones, we would like to meet you. As a Back-end developer, you’ll work closely with our engineers to ensure system consistency and improve user experience. Ultimately, you should be able to develop and maintain functional and stable web applications to meet our company’s needs. Responsibilities • Participate in the entire application lifecycle, focusing on coding and debugging. • Write clean code to develop functional web applications. • Troubleshoot and debug applications. • Perform UI tests to optimize performance. • Manage cutting-edge technologies to improve legacy applications. • Collaborate with Front-end developers to integrate user-facing elements with server-side logic. • Gather and address technical and design requirements. • Provide training and support to internal teams. • Build reusable code and libraries for future use. • Liaise with developers, designers and system administrators to identify new features. • Follow emerging technologies. Requirements • 3-5 Years of work experience as a Back-end developer. • In-depth understanding of the entire web development process (design, development and deployment). • Hands on experience with programming languages like Java, Ruby, PHP and Python. • Working knowledge of CMS framework. • Familiarity with front-end languages (e.g. HTML, JavaScript, AngularJS and CSS). • Excellent analytical and time management skills. • Teamwork skills with a problem-solving attitude. • BSc or B-tech degree in Computer Science or relevant field. M-tech degree in relevant field is preferred but not required.
Read more
BookEventz
at BookEventz
1 recruiter
Kunal Gupta
Posted by Kunal Gupta
Mumbai
1 - 2 yrs
₹3L - ₹5L / yr
Sales
Operations
Sales Operations
Market Research
Analytical Skills
Event Sales and Operations BookEventz.com welcomes career inquiries from Passionate, Energetic individuals who are interested in working in a startup environment, taking up bigger responsibilities and have interests in the event industry. If you feel that there is an entrepreneurial drive in you are you are ready for taking bigger challenges then BookEventz.com is a place for you. Job objectives :- Event planning, design, and production while managing all project delivery elements within time limits- Liaise with clients to identify their needs and to ensure customer satisfaction- Conduct market research, gather information and negotiate contracts prior to closing any deals- Propose ideas to improve provided services and event quality- Organize facilities and manage all event's details such as decor, catering, entertainment, transportation, location, invitee list, special guests, equipment, promotional material etc- Specify staff requirements and coordinate their activities- Proactively handle any arising issues and troubleshoot any emerging problems on the event day- Conduct pre- and post - event evaluations and report on outcomes- Research market, identify event opportunities and generate interest Requirements : We are looking for a Young and Energetic Person who is :- Previous experience of managing team & operations for atleast 1 year - Exceptional business and analytical skills- Strong communicator & negotiator and a multitasker- Ability to handle pressure and manage parallel operations- A perfectionist and a process driven approachWe are looking for go-getters, who are passionate about what they do, like events and its execution and have an eye for detail.Come to be a part of the team that will redefine the Event Booking Experience!Location: Mumbai
Read more
ezhome
at ezhome
2 recruiters
Liz Peterson
Posted by Liz Peterson
anywhere
2 - 5 yrs
₹17L - ₹35L / yr
Mobile App Testing (QA)
Performance Testing
Software Testing (QA)
Test Planning
In this role you’ll be working in a remote setting with a diverse team of world class engineers building mobile and web applications. You will report directly to the Director of Engineering and we expect that you will have huge impact in the way we think about quality. This position has a great potential for someone who wants to evolve his career quickly along with a fast growing technology startup. As a QA Engineer you will estimate, plan, and perform testing activities. You will be self-directed in selecting test approach and methods and executing necessary amount of testing on assigned products to ensure their high quality and flawlessness.
Read more
platoWorks
at platoWorks
1 video
1 recruiter
Plato Works
Posted by Plato Works
NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹4L - ₹5L / yr
Digital Marketing
Search Engine Optimization (SEO)
Google Adwords
Web Analytics
skill iconGoogle Analytics
+1 more
If interested, kindly fill the google form: Digital Marketing Executive: https://goo.gl/forms/Kq1KbUzgQpMXjggn1 Roles and Responsibilities • Monitor, plan and enhance company’s social media presence • Increase company and brand awareness by launching optimized online adverts through Facebook, Google Adwords etc. • Active involvement in SEO efforts (keywords, image optimization etc.) • Promotional E-mails and their distribution through various channels • Suggest creative ideas for content marketing • Website updating and collaboration with web designers to improve user experience • Measure digital marketing efforts by using various Web analytics tools (Google Analytics, WebTrends etc.) Skills and Other Requirements • Bachelor’s Degree or equivalent • 1-3 years of Digital Marketing experience • Strong analytical skills • Up-to-Date with current trends and best practices followed in online marketing • Experience in devising creative digital campaigns for the target audiences PlatoWorks About We at PlatoWorks explore and build products in Blockchain, Cryptocurrencies and VR/AR. We help traditional businesses become more efficient, streamlined, creative and innovative by helping them realize the potential of latest tech - Blockchain and VR/AR. We provide complete end to end solutions and even help companies in research based projects that require engineers and manpower that can approach a problem through non-traditional and unconventional routes. Benefits of Joining • Challenging Startup Environment • Extensive learning opportunity to develop and enhance your skills • Develop leadership qualities – Lead projects on your own • Flexible work timings • Free snacks and drinks
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos