2

I am working on a live sensor data set and looking for abnormal patterns (leading to a machine fault condition) from the available data set.

I am learning and new to the world of data science, but comfortable with Python. I have few questions that I am looking to get suggestions.

  1. What kind of algorithms would be best suited for this case?
  2. What are the basic steps for doing a predictive analysis in python?

Please correct me if my questions are not correctly framed.

Stephen Rauch
  • 1,783
  • 11
  • 21
  • 34
Vikas Gaikwad
  • 21
  • 2
  • Depends on your dataset's Complexity.. Welcome to the Site.. – Aditya Mar 22 '18 at 18:40
  • I am dealing with time series data, symptoms of faulty conditions depends on multiple parameters. – Vikas Gaikwad Mar 22 '18 at 18:43
  • 2
    What will and what won't work, their is no assurance to that point in ML....It's just we say that it should work in this case... Doing an EDA is the first step, checking which components get replaced frequently,are there parts which stops working on same day, time of the week etc.. doing feature engineering (adding new features) and them applying a DL model which suits my understanding is what I would do.. – Aditya Mar 22 '18 at 19:02
  • This is a really broad question - you are asking for information about a methodology that incorporates most of statistics... – Spacedman May 27 '18 at 07:10
  • what kind of sensor do you have? – Francesco Pegoraro Sep 24 '18 at 14:23
  • Check on this paper Machine learning application for sensor failure detection in polymerization process on [SBrT](https://www.dropbox.com/s/89k2t7swo064afk/Anais_SBrT_2018_v2.pdf?dl=0) and – Pedro Henrique Monforte Apr 06 '19 at 12:52
  • have a look at this: https://datascience.stackexchange.com/questions/32126/looking-for-good-package-for-anomaly-detection-in-time-series – pythinker Apr 06 '19 at 18:53

2 Answers2

0

You are talking about anomaly detection, and there are many approaches. If you can create a training set, one-class SVM is a place to start, but even simple control charts can be useful, particularly with live streaming data.

HEITZ
  • 911
  • 4
  • 7
0

If you have a dataset with labeled anomalies, then you can use a binary classification approach. If the anomalies are not labeled, then you have to look into outlier/novelty detection. The scikit-learn documenation has a good overview.

Jon Nordby
  • 1,377
  • 8
  • 13