



We are looking for an outstanding Big Data Engineer with experience setting up and maintaining Data Warehouse and Data Lakes for an Organization. This role would closely collaborate with the Data Science team and assist the team build and deploy machine learning and deep learning models on big data analytics platforms.
Roles and Responsibilities:
- Develop and maintain scalable data pipelines and build out new integrations and processes required for optimal extraction, transformation, and loading of data from a wide variety of data sources using 'Big Data' technologies.
- Develop programs in Scala and Python as part of data cleaning and processing.
- Assemble large, complex data sets that meet functional / non-functional business requirements and fostering data-driven decision making across the organization.
- Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems.
- Implement processes and systems to validate data, monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Provide high operational excellence guaranteeing high availability and platform stability.
- Closely collaborate with the Data Science team and assist the team build and deploy machine learning and deep learning models on big data analytics platforms.
Skills:
- Experience with Big Data pipeline, Big Data analytics, Data warehousing.
- Experience with SQL/No-SQL, schema design and dimensional data modeling.
- Strong understanding of Hadoop Architecture, HDFS ecosystem and eexperience with Big Data technology stack such as HBase, Hadoop, Hive, MapReduce.
- Experience in designing systems that process structured as well as unstructured data at large scale.
- Experience in AWS/Spark/Java/Scala/Python development.
- Should have Strong skills in PySpark (Python & SPARK). Ability to create, manage and manipulate Spark Dataframes. Expertise in Spark query tuning and performance optimization.
- Experience in developing efficient software code/frameworks for multiple use cases leveraging Python and big data technologies.
- Prior exposure to streaming data sources such as Kafka.
- Should have knowledge on Shell Scripting and Python scripting.
- High proficiency in database skills (e.g., Complex SQL), for data preparation, cleaning, and data wrangling/munging, with the ability to write advanced queries and create stored procedures.
- Experience with NoSQL databases such as Cassandra / MongoDB.
- Solid experience in all phases of Software Development Lifecycle - plan, design, develop, test, release, maintain and support, decommission.
- Experience with DevOps tools (GitHub, Travis CI, and JIRA) and methodologies (Lean, Agile, Scrum, Test Driven Development).
- Experience building and deploying applications on on-premise and cloud-based infrastructure.
- Having a good understanding of machine learning landscape and concepts.
Qualifications and Experience:
Engineering and post graduate candidates, preferably in Computer Science, from premier institutions with proven work experience as a Big Data Engineer or a similar role for 3-5 years.
Certifications:
Good to have at least one of the Certifications listed here:
AZ 900 - Azure Fundamentals
DP 200, DP 201, DP 203, AZ 204 - Data Engineering
AZ 400 - Devops Certification

About netmedscom
About
Connect with the team
Similar jobs

Job Title: Frontend Developer (React.js)
Location: Bangalore
Job Description:
Company is looking for a skilled Frontend Developer with experience in React.js to join our team at Timely.ai. In this role, you will be responsible for building and maintaining the user-facing side of our web applications. You will work closely with our designers and back-end developers to deliver high-quality, responsive, and interactive web experiences to our users.
Key Responsibilities:
- Develop new user-facing features using React.js
- Build reusable components and front-end libraries for future use
- Ensure the technical feasibility of UI/UX designs
- Optimize applications for maximum speed and scalability
- Collaborate with other team members to design and develop new features
- Stay up-to-date with the latest advancements in front-end technologies and frameworks
Qualifications:
- Strong proficiency in React.js, HTML, CSS, and JavaScript
- Experience with Redux or other state management libraries
- Experience with webpack and other build tools
- Experience with unit testing and end-to-end testing
- Strong understanding of web development principles and best practices
- Strong problem-solving and debugging skills
- Proven ability to work in a fast-paced, Agile development environment
- Strong communication and teamwork skills
- Bachelor's degree in Computer Science or related field or equivalent experience
We offer a competitive salary, benefits package, and an opportunity to work on cutting-edge technologies with a dynamic team. If you are passionate about building great user experiences and want to make a difference in the world, we want to hear from you!
Please apply with your resume and a portfolio of your work


- Developer will be responsible for managing back-end services and the interchange of data between the server and the users.
- Your primary focus will be the development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end.
- Knowledge of PHP web frameworks (Code igniter, Magento, Laravel etc).
- Should have experience in Word Press, Code igniter / Laravel or at-lease 1 MVC framework of PHP.
- Proficiency in HTML5, CSS3, and JavaScript JQuery.
- Good communication.
- Team worker.
- Ability to handle projects.
- Good problem-solving skills.
Who We Are Looking For:
We are looking for a driven Blockchain & Solidity Developer who learns fast, who is humble and values teamwork. The ideal candidate will be technical, data-driven, creative, and efficient. The kind of person who joins our Team is passionate and willing to think outside of the box and execute on it. We are committed to helping you grow, challenging you with hard, meaningful work and celebrating our successes and failures together.
Preferred Experience:
- 3+ years of software experience ( Full stack) , 1+ years of Solidity development experience
- Presently leading as CTO, Tech Lead or Technical Project manager at established crypto project
Technical Skills
- Experience in development of solidity smart contracts and operating mechanism of blockchain encryption algorithms, consensus mechanism, security protocols etc.
- Proven work experience of deployments on ETH/BSC/MATIC networks and other EVM Chains
- Understanding of virtual machine architecture, memory, and stack.
- Familiar with Truffle, Waffle, and Hardhat, and the pros and cons of each framework.
- Familiarity with code versioning tools (git) and repo management.
- (Plus) Understanding of mainstream DeFi ecosystems like Uniswap, Compound, Curve etc.
Soft Skills
- Proficiency in English & Communication
- Team Collaboration and task management
What You Will Be Doing:
- Collaborates with the team on conceptualizing and developing new applications. Write high-quality, pragmatic code as part of a multidisciplinary agile team.
- Participate in design, development and code reviews.
- Take accountability for end-to-end production, testing, and shipping of code.
Our Offering:
- Purpose: You’ll be part of something bigger, working towards building a decentralized financial ecosystem.
- Culture: You’ll work in a thriving, friendly, and fun environment that promotes open discussions, jokes, learning, video games, and lots of fun.
- People: You’ll work with some of the most driven and intelligent people in the crypto space, engaging with a network of diverse talent team members & advisors.
- Flexible vacation policy: work with your manager to take time off when you need it

Ruby and Rails
Creating JSON based web services from Ruby on Rails (RoR) apps
HTML5, CSS3, JavaScript, jQuery, CoffeeScript, Ajax, lodash/underscore.js
A firm grasp of object-oriented analysis and design
Good to have knowledge in any front end framework, Angular or above versions, Backbonejs, Ember.js
Should have extensive experience in Agile software development principles, practice, and process
Should have worked on enterprise-cl applications
RoR Performance tuning and scaling
Proficiency in English strongly preferred
A proactive and resourceful person who achieves with minimal oversight
Team player with the ability and desire to become an integral part of a fast-paced team
Good knowledge of relational databases MySQL, Oracle, Microsoft SQL Server, DB2 or similar
Hands-on experience with at least one of the NoSQL environments like MongoDB, Couchbase, Cassandra
Experience with text search systems like elastic, solr or similar
Hands-on experience in integrating with third-party REST APIs
Managing code with Git and other version control tools
Good to have knowledge of Nginx

Location: Mohali
Working days: 5
- 4+ years of experience in Angular (6 and above) based UI development.
- Expert in modern JavaScript MV-VM/MVC frameworks (Angular, JQuery, NodeJS)
- Proficient in developing front-end applications/ responsive applications with Angular, HTML5, CSS3, Bootstrap, JavaScript, jQuery, AJAX.
- Hand on experience with Angular Components, Directives, Services, Http Client, Interceptors, Routing
- In-depth knowledge of Typescript
- Design and develop UI wireframes based on the requirements.
- Plan the layout of the website.
- Good understanding of Table less Design / Table less Layout using CSS and also experience of fixing cross browser and cross platform issues.
- Good understanding of asynchronous request handling, partial page updates, and AJAX.
- Experience in designing various forms, tooltips, menus, tabs, animated effects, data and time selector and many others using jQuery toolkit and custom libraries.
- Experience developing custom reusable components
- Understanding of key design principles.
- Strong experience working with RESTful APIs.
- Good understanding in entire Software Development Life Cycle and worked on Agile software development methodologies, secure coding standards, code reviews, source control management, continuous integration, build processes, testing and operations.
- Analyze user requirements and convert requirements to design documents
- Compile timely, comprehensive and accurate documentation and or reports as requested
- Strong written and verbal communication skills.
● Build new features to allow for rapid product experimentation to power web and
android applications, implementing features in an efficient way
● Incrementally adapt an existing Node.js monolith for scalability and very fast growth
● Deliver within project timelines through diligent planning and attention to detail.
● Keep key stakeholders informed about progress and problems; avoid surprises.
● Identify and report performance bottlenecks wherever feasible
● Follow testing and documentation best practices for the services developed.
● Work in a dynamic and collaborative culture ensuring good teamwork and
communication with remote team members when needed
Requirements
● 2 or more years of backend development experience
● At least 1 year of experience with Node.js frameworks like Express, Koa, Sail etc.
● Strong problem-solving skills. Good knowledge of data structures and algorithms.
● Solid understanding design patterns and OOP concepts; familiarity with
object-oriented JS (asynchronous code, events loop etc) is highly preferable
● Strong hands-on exp of relational DBMS concepts with PostgreSQL / other SQL DBs
● Ability to quickly design and implement optimized solutions for feature requirements
● Good understanding of the fundamental design principles for a scalable application
● Strong handle over Git, following best practices to facilitate collaboration
Nice to haves
● Experience working with apps in a microservices architecture
● Familiarity with caching solutions like Redis, Memcached etc
● Knowledge of testing best practices and concepts of test-driven development and
experience with unit testing frameworks in any of the major programming languages
● Familiarity with documentation tools and generators for Node.js applications


- Proficient in Python 2 / 3 and have built products before (managing the entire DevOps cycle) - proficient in Python Data Structures
- Good understanding of Open Source Visualisation Tools like D3.JS, Matplotlib etc.
- Good understanding of Functional APIs and Data Ingestion viz. Pandas’ dataframe from SQL DB and Excel (CSV) & Flat files of (primarily) structured data - no data cleansing
- Growth mindset - eagerness to learn and grow in the role
- Qualifications: B.Tech / BE / Graduate Engineer in any stream (preferred Mech / Industrial Engineer)
- Compensation : At par with industry (with stock options / grants to be vested over 3 years)


