Terms Glossary D Data Lake
Edit This Term Record

Data Lake

Coined by Pentaho CTO James Dixon, a data lake is a massive data repository, designed to hold raw data until it’s needed and to retain data attributes so as not to preclude any future uses or analysis.
Read More
The data lake is stored on relatively inexpensive hardware, and Hadoop can be used to manage the data, replacing OLAP as a means to answer specific questions. Sometimes referred to as an “enterprise data hub,” the data lake and its retention of native formats sits in contrast to the traditional data warehouse concept.
Read More
Connectedthinks
Connectedthinks
Industrial data platformThe ConnectedThinks Industrial data platform is capable of connecting to multiple industrial data sources, correlating and transforming the data into useful insights, and helping improve the efficiency of your industrial business.Edge ConnectorsThe edge-connectors suite is a middleware deployable on ARM or X86-based Industrial edge IoT gateways. It enables quick connection and rapid onboarding of various assets such as machinery, sensors, asset trackers, Bluetooth beacons, and IP Video streams as well as OT assets such as PLC, SCADA, CNC, and HMI – to name a few. It offers secure device management and remote connection. Data PlatformThe ConnectedThinks data platform is a modern technology stack, built-to-scale to ingest and process high-speed, high-density, and real-time industrial data. Its functionality could be split into 3 primary parts – the data-ingest, the data-transform-&-store, and the data-query part.The data-ingest part consists of a high-performant MQTT broker and a highly-scalable, multi-cluster Kafka messaging queue which together can ingest and process data at a very high speed.The data-transform-&-storage part is built on top of Kafka KSQLdb and Apache Spark with real-time data transformation and the ability to integrate real-time machine-learning predictions for Anomaly Detection and other Predictive Maintenance tasks. The platform offers out-of-the-box connectors to store data on almost any database, data warehouse, or even into S3-storage compatible Data Lakes with efficient storage formats like PARQUET and AVRO.The data-query part consists of multiple custom-built connectors to various SQL and pseudo-SQL databases and storages along with highly-scalable PRESTO (a.k.a prestodb)Together it forms a complete Industry 4.0 offering for data intelligence and integration. The entire offering is built with Microservices and dockerized to make it suitable for deployment on-prem, private-cloud, or Public Cloud like AWS, Azure, or Google. Data visualization & BIConnectedThinks platform offers a custom-built visualization engine, built from the ground up to serve the specific requirements of industrial operations which demand a combination of real-time diagnostic monitoring for high-speed data, a SCADA-like monitoring system with visual aids and historical data analytics with data ranging from a few weeks to couple years. It is built on top of front-end REACT-js libraries along with Authentication and fine-grain access Authorization to deliver a secure web portal that is accessible from any corner of the world. The platform is also pre-integrated with Apache Superset and offers embedded dashboards as well as quick drag-and-drop data exploration. The prestodb query engine ODBC connectors enable you to import and explore data from your existing BI solutions such as Tableau, Looker, PowerBI, etc,
Esono AG
Esono AG
For more than 20 years, Esono AG has been developing and implementing scalable solutions for clients from a wide range of industries. With many years of experience, agility and innovative spirit, Esono is your reliable and competent project partner and consultant.
test test