We have urgent requirement of Data Engineer/Sr Data Engineer for reputed MNC company.
Exp: 4-9yrs
Location: Pune/Bangalore/Hyderabad
Skills: We need candidate either Python AWS or Pyspark AWS or Spark Scala
Similar jobs
Job Description:-
Design, develop IoT/Cloud-based Typescript/ JavaScript/ Node.JS applications using
Amazon Cloud Computing Services.
Work closely with onsite, offshore, and cross functional teams, Product Management, UI/UX developers, Web and Mobile developers, SQA teams to effectively use technologies to build and deliver high quality and on-time delivery of IoT applications
Bug and issue resolution
Proactively Identify risks and failure modes early in the development lifecycle and develop.
POCs to mitigate the risks early in the program.
Assertive communication and team skills
Primary Skills:
Hands on experience (3+ years) in AWS cloud native environment with work experience in
AWS Lambda, Kinesis, DynamoDB
3+ years’ experience in working with NodeJS, Python, Unit Testing and Git
3+ years in work experience with document, relational or timeseries databases
2+ years in work experience with typescript.
1+ years in IaaS framework like Serverless or CDK with CloudFormation knowledge
Role and Responsibilities |
|
Required Skills |
|
1. Proficiency in Python 3.x based web and backend development
2. Solid understanding of Python concepts
3. Experience with some form of Machine Learning (ML)
4. Experience in using libraries such as Numpy and Pandas
5. Some form of experience with NLP and Deep Learning using any of Pytorch, Tensorflow, Keras, Scikit-learn or similar
6. Hands on experience with RDBMS such as Postgres or MySQL
7. Experience building REST APIs using DRF or Flask
8. Comfort with Git repositories, branching and deployment using Git
9. Working experience with Docker
10. Basic working knowledge of ReactJs
11. Experience in deploying Django applications to AWS,Digital Ocean or Heroku
Sureify drives customer engagement between the customer and their insurance company by incorporating web & mobile apps, into the insurance product experience. Our product is controlled by our backend dashboard so insurers can get the latest IoT data streaming in. The SaaS platform is designed to ensure that insurers never miss opportunities to increase engagement with their existing customer base.
We are looking for a Full Stack Web Developer who is motivated to combine the art of design with the art of programming. Responsibilities will include translation of the UI/UX design wireframes to actual code that will produce visual elements of the application. You will work with the UI/UX designer and bridge the gap between graphical design and technical implementation, taking an active role on both sides and defining how the application looks as well as how it works. On the backend, you will have the opportunity to help our product scale and be involved in the further architecture of the Sureify platform.
Responsibilities
- Develop new user-facing features
- Build reusable code and libraries for future use
- Build scalable architecture to support millions of users
- Ensure the technical feasibility of UI/UX designs
- Work closely with the UI/UX designers and product managers
- Optimize application for maximum speed and scalability
- Assure that all user input is validated before submitting to the back-end
- Collaborate with other team members and stakeholders
Skills And Qualifications
- Proficient understanding of web markup, including HTML5, CSS3
- 2+ years of experience with Full-Stack web development
- Proficient in PHP or Python or Golang.
- Experience in Golang is an added advantage.
- Proficient understanding of client-side scripting and JavaScript frameworks, including jQuery
- Good understanding of asynchronous request handling, partial page updates, and AJAX.
- Use test-driven development and acceptance tests to ensure feature quality
- Excellent relational database skills with MySQL
- Experience with building restful JSON web services
- Knowledge of APIs, such as Twitter, Facebook, Google maps, Instagram, etc.
Job Description
- Managing the interchange of data between the server and the users.
- Development of all server-side logic, ensuring high performance and responsiveness to requests from the front-end Integrating the front-end elements built by your co-workers into the application; therefore, a basic understanding of front-end technologies is necessary as well.
- Writing reusable, testable, and efficient code.
- Design and implementation of low-latency, high-availability, and performant applications.
- Integration of user-facing elements developed by front-end developers with server-side logic
- Implementation of security and data protection.
Expected experience with
- Should have worked on the Django REST framework.
- Familiarity with some Pandas, Numpy, text parsing/mining and ORM (Object Relational Mapper) libraries
- Able to integrate multiple data sources and databases into one system
- Understanding of the threading limitations of Python, and multi-process architecture
- Good understanding of server-side templating languages
- Worked on Amazon cloud solutions
- Understanding of accessibility and security compliance
- Knowledge of user authentication and authorization between multiple systems, servers, and environments
- Understanding of fundamental design principles behind a scalable application
- Familiarity with event-driven programming in Python
- Able to create database schemas that represent and support business processes
- Strong unit test and debugging skills
- Proficient understanding of code versioning tool
- Excellent written and verbal communication skills.
- Should know about HDL and LLD.
- Should know about making python packages
- Should have worked on microservice-based Architecture
- As a polyglot developer Ideally, you should have:
- 1.5+ years of development experience using any of technology java, scala, python or any similar exciting technologies.
- Hands-on experience in coding, and implementation of complex, custom-built applications Working knowledge of build tool like maven/sbt and code versioning systems like git/bitbucket/cvs/svn
- Familiarity with few databases, like MySQL, Oracle, PostgreSQL, SQL Server, NoSQL etc Great OO skills, including strong design patterns knowledge
- Good communication and ability to work in a consulting environment is essential
- Think through hard problems in a consultancy environment, and work with amazing people to make the solutions a reality Work in a dynamic, collaborative, non-hierarchical environment where your talent is valued over your job title or years of experience
- Build custom software using the latest technologies and tools Craft your own career path
- Providing solution to real problems in Bigdata world.
- RnD on using the latest tools,techniques and cloud services.
- Automating the manual-timetaking tasks.
- Hands-on coding, usually in a pair programming environment.
- Working in highly collaborative teams and building quality code
- Working in lots of different domains and client environments
- Understanding the business domain deeply
We are a team of technology agnostic, passionate people who aim to provide solution to real world Bigdata problems.
We are building solutions that will help our customers to do automatic migration of their RDBMS systems to latest BIGDATA platforms and tools such as Spark, Apex, Flink etc. For more information do visit our products webpage.
We’re a small team looking for passionate, execution-focused, self-starters to help us build the next generation eCommerce platform and equal the playing field for all. Our success depends on building teams who can challenge each other's assumptions with fresh perspectives. To that end, we don’t just accept differences – we celebrate them. If that sounds exciting to you, let’s talk!
We are expanding our Engineering team to India and building a stellar and diverse team composed of owners. We are looking for a backend engineer with a demonstrated track record of developing and maintaining production services, innovative thinking, and technical excellence. As a backend engineer, you will be responsible for building out the service layer that powers our frontend applications. You should have a solid understanding of software development lifecycle and software design principles. This is a great opportunity if you are looking for a huge impact at a small start-up with immense growth potential.
What you will do?
Create technical plans of projects assigned to you.
Come up with well-structured solutions to ambiguous problems and implement them.
Ship high-quality, well-tested, secure, and maintainable backend code.
Provide technical direction on our various products and upcoming projects.
Champion reliability and quality by using best practices in software engineering and modular design.
Ensure all components are scalable, maintainable, and have in-built metrics instrumentation and monitoring
Deliver an exceptional user experience to our customers. Put the customer first and have quality in mind.
Own the full release cycle from development to deployment.
What you will need?
3+ Years of experience as a software engineer working on backend applications.
Advanced knowledge of Python (preferably, the Django framework) and relational databases.
Experience with agile, test-driven development, continuous integration, and automated testing.
Experience with building, modifying, and extending API endpoints (REST or GraphQL) for data retrieval and persistence.
Experience with the full software development life cycle, including requirements collection, design, implementation, testing, and operational support.
Excellent verbal and written communication, teamwork, decision making and influencing skills.
Experience with scrum or other agile software development methodology.
Hustle. Thrives in an evolving, fast-paced, ambiguous work environment.
Bonus if you have
Experience working in the eCommerce domain.
Experience with AWS technologies like Elastic Beanstalk, Amplify, etc.