International business machines corporation (20240320565). AUTOMATED FEATURE ENGINEERING simplified abstract

From WikiPatents
Jump to navigation Jump to search

AUTOMATED FEATURE ENGINEERING

Organization Name

international business machines corporation

Inventor(s)

Kunal Sawarkar of Franklin Park NJ (US)

Shivam Raj Solanki of Austin TX (US)

Christopher Chen of San Jose CA (US)

Amit P. Joglekar of Olathe KS (US)

AUTOMATED FEATURE ENGINEERING - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240320565 titled 'AUTOMATED FEATURE ENGINEERING

Simplified Explanation: The patent application discusses feature engineering in automated machine learning, focusing on processing streaming data from sensors to detect anomalies.

Key Features and Innovation:

  • Receiving streaming data from sensors representing at least one attribute over time.
  • Computing long-term point statistics associated with the streaming data.
  • Quantizing the streaming data into time windows and computing short-term point statistics.
  • Normalizing the long-term and short-term point statistics.
  • Applying dynamic time warping to compare the normalized statistics.
  • Generating probability distributions based on the dynamic time warped statistics.
  • Producing machine learning input features based on the distance between the mean values of the probability distributions.
  • Training a machine learning model to detect anomalies using the input features.

Potential Applications: This technology can be applied in various industries such as healthcare, finance, cybersecurity, and manufacturing for anomaly detection in real-time data streams.

Problems Solved: The technology addresses the challenge of efficiently processing streaming data from sensors and detecting anomalies in a timely manner.

Benefits:

  • Improved accuracy in anomaly detection.
  • Real-time monitoring and alerting.
  • Enhanced efficiency in processing large volumes of streaming data.

Commercial Applications: Potential commercial applications include real-time fraud detection in financial transactions, predictive maintenance in manufacturing equipment, and early detection of health issues in medical devices.

Prior Art: Researchers can explore prior art related to dynamic time warping, anomaly detection in streaming data, and feature engineering in machine learning.

Frequently Updated Research: Stay updated on advancements in anomaly detection algorithms, sensor technology, and machine learning models for real-time data processing.

Questions about Feature Engineering in Automated Machine Learning: 1. How does dynamic time warping improve anomaly detection in streaming data? 2. What are the key challenges in processing streaming data for anomaly detection?


Original Abstract Submitted

feature engineering, for example, in automated machine learning, can include receiving streaming data representing at least one attribute detected by a sensor over time. long term point statistics associated with the streaming data can be computed. the streaming data can be quantized into intervals of time windows and short term point statistics based on the intervals can be computed. the long term point statistics and the short term point statistics can be normalized. dynamic time warping can be applied across the normalized long term point statistics and short term point statistics. a pair of probability distributions can be generated associated with the dynamic time warped normalized long term point statistics and short term point statistics. based on distance between the mean values of the probability distributions, machine learning input features can be produced. the machine learning input features can be fed to train a machine learning model for detecting anomaly.