Hi All,
We are hiring!!
Company: SpringML India Pvt Ltd.
Role:Lead Data Engineer
Location: Hyderabad
Website: https://springml.com/">https://springml.com/
About Company:
At SpringML, we are all about empowering the 'doers' in companies to make smarter decisions with their data. Our predictive analytics products and solutions apply machine learning to today's most pressing business problems so customers get insights they can trust to drive business growth.
We are a tight-knit, friendly team of passionate and driven people who are dedicated to learning, get excited to solve tough problems and like seeing results, fast. Our core values include placing our customers first, empathy and transparency, and innovation. We are a team with a focus on individual responsibility, rapid personal growth, and execution. If you share similar traits, we want you on our team.
What's the opportunity?
SpringML is looking to hire a top-notch Lead Data Engineer who is passionate about working with data and using the latest distributed framework to process large dataset.
As a Lead Data Engineer, your primary role will be to design and build data pipelines. You will be focused on helping client projects on data integration, data prep and implementing machine learning on datasets.
In this role, you will work on some of the latest technologies, collaborate with partners on early win, consultative approach with clients, interact daily with executive leadership, and help build a great company. Chosen team members will be part of the core team and play a critical role in scaling up our emerging practice.
Responsibilities:
- Ability to work as a member of a team assigned to design and implement data integration solutions.
- Build Data pipelines using standard frameworks in Hadoop, Apache Beam and other open-source solutions.
- Learn quickly – ability to understand and rapidly comprehend new areas – functional and technical – and apply detailed and critical thinking to customer solutions.
- Propose design solutions and recommend best practices for large scale data analysis
Skills:
- B.tech degree in computer science, mathematics or other relevant fields.
- 6+years of experience in ETL, Data Warehouse, Visualization and building data pipelines.
- Strong Programming skills – experience and expertise in one of the following: Java, Python, Scala, C.
- Proficient in big data/distributed computing frameworks such as Apache Spark, Kafka,
- Experience with Agile implementation methodology
Similar jobs
Responsibilities:
- Participate in the entire application lifecycle, focusing on coding and debugging.
- Write clean code to develop functional web applications.
- Troubleshoot and debug applications.
- Perform UI tests to optimize performance.
- Manage cutting-edge technologies to improve legacy applications.
- Collaborate with Front-end developers to integrate user-facing elements with server side logic.
- Provide training and support to internal teams.
Requirements:
- Experience: 3- 6 years.
- Education Qualification: B. E/ MCA/ B. Tech/ M. Tech/ BCA.
- Skills: Python, Django, Flask, SQL, AWS, Azure, Git.
- Having 3 years of experience in developing backend distributed applications in Python.
- Solid hands-on experience as Python Developer in advanced Python programming.
- Strong knowledge of building RESTful APIs using Python frameworks (e. g. Django, Flask, Web2Py, Tornado).
- Good knowledge on development and accessing web services (REST).
- Should have worked on cloud platforms/services offered by AWS, Azure or GCP (Google Cloud Platform).
- Good understanding of Data Structures and Oops Concepts.
- Understanding of databases and SQL.
- Expertise in developing production ready Micro services in Python.
- Understanding of the threading limitations of Python, and multi-process architecture.
- Proficient understanding of code versioning tools, such as Git.
- Effective oral & written communication skills.
Job Description
Roles and Responsibilities
· Design, Code, test, debug, implement and document complex WSO2 sequences.
· Monitoring and logging tool stacks - Splunk/ELK/Prometheus, Grafana 4 Design, Code, test, debug, implement and document complex WSO2 sequences.
· Perform Build activities for WSO2 ESB Middleware integration, involves writing XSLT, ESB coding, configuration, and Analysis activities.
· Trouble shooting various problems in different stages of development using logs files, Traces and Log Analyzer.
· Responsible for understanding the requirement, solution design, coordinate the development and testing activities (end to end)
· Guide the team regarding WSO2 platform best practices, framework, reusable artefacts and ensure code quality and timely deliverables.
· Work with functional and technical customers to determine solutions that drive additional business value.
· Work with Github, Azure Devops and CI tools to automate dev, build, deployment and testing.
· Good knowledge in messaging brokers: WSO2 Message Broker, Apache Kafka.
· Monitoring the server (Monitoring logs and WSO2 metrics).
· Desired Candidate Profile
Desired Candidate Profile
· Candidate must have minimum 2+ years of hands-on experience in WSO2, preferably with WSO2 certification.
· Extensive experience in Integration by using WSO2 Product Stack (API Manager 2.6/3.x, Enterprise Integrator 6.5 and Identity Server 5.7.0)
· Experience in Implementing APIs in WSO2 EI and On-boarding APIs into WSO2 API Manager
· Experience in WSO2 API Manager for designing API facades and designing and implementing API Proxies.
· Hands-on experience in designing and developing high volume web services using API Protocols and Data Formats (REST, JSON, SOAP & XML).
· Must have hands on experience / knowledge with CI tools to automate dev, build, deploy.
· Experience in programming languages: Java, JavaScript, Python
· Experience in on boarding web applications into WSO2 Identity Server for authentication and authorizatio
Qualifications
• Minimum of a Bachelor's or Master’s degree in Computer Science, or a related four-year degree.
• 4 years of hands on experience in Integration
- Degree in Computer Science (BS/MS), related technical field or equivalent practical experience
- 8+ years of industry experience in product development
- Experience in coaching and mentoring team members
- Must own a specific component of the product. Gathering requirements by working with product management. Working closely with development managers in defining external product interfaces
- Must have excellent written and verbal communication skills. Must articulate various design approaches and design decisions clearly - within the team and across the teams.
- Must work with QA engineers to devise proper test constructs - unit testing and integration tests.
Our goal
We are reinventing the future of MLOps. Censius Observability platform enables businesses to gain greater visibility into how their AI makes decisions to understand it better. We enable explanations of predictions, continuous monitoring of drifts, and assessing fairness in the real world. (TLDR — build the best ML monitoring tool)
The culture
We believe in constantly iterating and improving our team culture, just like our product. We have found a good balance between async and sync work — default is still Notion docs over meetings, but at the same time, we recognize that as an early-stage startup brainstorming together over calls leads to results faster. If you enjoy taking ownership, moving quickly, and writing docs, you will fit right in.
The role:
Our engineering team is growing and we are looking to bring on board a senior software engineer who can help us transition to the next phase of the company. As we roll out our platform to customers, you will be pivotal in refining our system architecture, ensuring the various tech stacks play well with each other, and smoothening the DevOps process.
On the platform, we use Python (ML-related jobs), Golang (core infrastructure), and NodeJS (user-facing). The platform is 100% cloud-native and we use Envoy as a proxy (eventually will lead to service-mesh architecture).
By joining our team, you will get the exposure to working across a swath of modern technologies while building an enterprise-grade ML platform in the most promising area.
Responsibilities
- Be the bridge between engineering and product teams. Understand long-term product roadmap and architect a system design that will scale with our plans.
- Take ownership of converting product insights into detailed engineering requirements. Break these down into smaller tasks and work with the team to plan and execute sprints.
- Author high-quality, highly-performance, and unit-tested code running on a distributed environment using containers.
- Continually evaluate and improve DevOps processes for a cloud-native codebase.
- Review PRs, mentor others and proactively take initiatives to improve our team's shipping velocity.
- Leverage your industry experience to champion engineering best practices within the organization.
Qualifications
Work Experience
- 5+ years of industry experience (3+ years in a senior engineering role) preferably with some exposure in leading remote development teams in the past.
- Proven track record building large-scale, high-throughput, low-latency production systems with at least 3+ years working with customers, architecting solutions, and delivering end-to-end products.
- Fluency in writing production-grade Go or Python in a microservice architecture with containers/VMs for over 5+ years.
- 2+ years of DevOps experience (Kubernetes, Docker, Helm and public cloud APIs)
- Worked with relational (SQL) as well as non-relational databases (Mongo or Couch) in a production environment.
- (Bonus: worked with big data in data lakes/warehouses).
- (Bonus: built an end-to-end ML pipeline)
Skills
- Strong documentation skills. As a remote team, we heavily rely on elaborate documentation for everything we are working on.
- Ability to motivate, mentor, and lead others (we have a flat team structure, but the team would rely upon you to make important decisions)
- Strong independent contributor as well as a team player.
- Working knowledge of ML and familiarity with concepts of MLOps
Benefits
- Competitive Salary 💸
- Work Remotely 🌎
- Health insurance 🏥
- Unlimited Time Off ⏰
- Support for continual learning (free books and online courses) 📚
- Reimbursement for streaming services (think Netflix) 🎥
- Reimbursement for gym or physical activity of your choice 🏋🏽♀️
- Flex hours 💪
- Leveling Up Opportunities 🌱
You will excel in this role if
- You have a product mindset. You understand, care about, and can relate to our customers.
- You take ownership, collaborate, and follow through to the very end.
- You love solving difficult problems, stand your ground, and get what you want from engineers.
- Resonate with our core values of innovation, curiosity, accountability, trust, fun, and social good.
We are looking for a Backend Developer who has 4-6 years of experience in designing, developing, and implementing backend services using Python and Django.
- Responsibilities-
- Design highly scalable, testable code and follow Test Driven Development methodology
- Able to write well-organized, modularised code with test cases.
- Contribute to the design and architecture of our backend APIs and deployment of microservices
- Ensure adherence to engineering best practices and maintain the overall quality of our codebase.
- Work with the product team to translate powerful ideas into everyday business value.
- Skills-
- Back-end programming language: Python
- Familiarity with Django or Flask framework
- Familiarity with AWS and Elastic Search
- Experience in SQL and NoSQL databases with an insight into various data modeling use cases
- Experience with system & unit testing
- Familiarity with containerized deployment
- Proficiency with Git
- Sound with data structures and algorithms and have a good understanding of design patterns, software architectures
- As a polyglot developer Ideally, you should have:
- 1.5+ years of development experience using any of technology java, scala, python or any similar exciting technologies.
- Hands-on experience in coding, and implementation of complex, custom-built applications Working knowledge of build tool like maven/sbt and code versioning systems like git/bitbucket/cvs/svn
- Familiarity with few databases, like MySQL, Oracle, PostgreSQL, SQL Server, NoSQL etc Great OO skills, including strong design patterns knowledge
- Good communication and ability to work in a consulting environment is essential
- Think through hard problems in a consultancy environment, and work with amazing people to make the solutions a reality Work in a dynamic, collaborative, non-hierarchical environment where your talent is valued over your job title or years of experience
- Build custom software using the latest technologies and tools Craft your own career path
- Providing solution to real problems in Bigdata world.
- RnD on using the latest tools,techniques and cloud services.
- Automating the manual-timetaking tasks.
- Hands-on coding, usually in a pair programming environment.
- Working in highly collaborative teams and building quality code
- Working in lots of different domains and client environments
- Understanding the business domain deeply
We are a team of technology agnostic, passionate people who aim to provide solution to real world Bigdata problems.
We are building solutions that will help our customers to do automatic migration of their RDBMS systems to latest BIGDATA platforms and tools such as Spark, Apex, Flink etc. For more information do visit our products webpage.
What do Microsoft, The Gap, Royal Bank of Scotland, Lockheed Martin, and top Open Source projects like JQuery have in common? They all use BrowserStack, as do over 25,000 other customers!
BrowserStack is the industry-leading, cloud web and mobile testing platform that enables developers to test their websites and apps on different operating systems and mobile devices. Since launching in 2011, our mission has been bold yet simple: To be the testing infrastructure for the internet. 6 years and billions of tests later, we are ready for our next phase of hyper growth. Bootstrapped for the first 6 years, we continue to be profitable since inception with a near exponential https://workable.com/nr?l=https%3A%2F%2Fwww.browserstack.com%2Fgrowth">growth in customers around the globe. Recently, we closed $50M in Series A funding from Accel
Are you are the one who wants to work on a tech-heavy product, and the challenging technical problems that it entails? Problems vary, and can be as diverse as scaling the product smoothly as the company grows, to setting up a device farm, or solving streaming issues through a browser, without the use of plugins. Will you be excited for the challenge to transform and think critically on many computer science disciplines including product design, usability, building APIs and user-centric online applications, business logic, scaling performance, and 24x7 reliability?
JOB RESPONSIBILITIES
- Writing high quality code, participating in code reviews, designing/architecting systems of varying complexity and scope, and creating high quality documentation supporting the design/coding tasks
- Lead out team meetings, stand-ups, and architecture/design discussions
- Identify areas of improvement in our frameworks, tools, processes and strive to make them better. Evaluate our success metrics and evolve our reporting systems
- Works on the web application layer, backend, systems, streaming and other associated technology to build our product and components
- Find solutions and solve issues around a variety of operating systems or programming languages
- Researching new technologies and adapt them to BrowserStack requirements
- Own and commit to all your work, and be accountable for your results
- Using and understanding code from Open Source
- Teaching others how to use new software
- Willing to learn new programming languages and databases
- Able to write efficient SQL queries and design schemas for relational databases
- Participate in a culture of code reviews, writing tech specs, and collaborating closely with other people (no lone wolves)
- Produce high quality software that is unit tested, code reviewed, and checked in regularly for continuous integration
- Develop multi-tier scalable, high-volume performing, and reliable user-centric applications that operate 24x7
- Scale distributed applications, make architectural trade-offs applying synchronous and asynchronous design patterns, write code, and deliver with speediness and quality
- Good experience in at least one scripting language: Ruby, Nodejs, Python, AppleScript, Unix shell or similar
- Familiarity with one compiled language: C, Java, Go or similar
- Good knowledge of operating systems and networking concepts
- Reasonable knowledge of Windows and/or Linux operating systems
- Ability to work on Windows and Linux platform below the application layer, including file systems, kernels, custom installations, shell scripting, internal APIs, etc
- Aggressive problem diagnosis and creative problem solving skills
- Startup mentality, high willingness to learn, and hardworking
- Experience of 3-6 years