This question has already been answered:

How to recognize numbers on a c # image? In general, you need to parse the entire desktop (screen), if you find the number "1", then take its coordinates and rearrange the mouse to this place, with the number "2" and other action figures are the same.

Marked as a duplicate by MSDN.WhiteKnight , AK ♦ , Dmitry Kozlov , mymedia , Andrey NOP c # Nov 10 '18 at 10:29 .

A similar question was asked earlier and an answer has already been received. If the answers provided are not exhaustive, please ask a new question .

  • 2
    Are you puzzling us? What did you do? What did not work out? - karmadro4
  • Made a color recognition :) Text - box drawing - Mr-Al

4 answers 4

Problem academic-level)))

If you take a screenshot, it is easy to move the mouse to the coordinates a bit more difficult.

That is the task of recognizing a certain symbol, and of a small size, moreover, on a blurred image ...

You try to make a hand-print screen of your desktop and feed it FineReader'y. Look at the horror that he recognizes there. And FR is not the first year to solve this problem))

    See tesseract-ocr .

    The OCR engine that was developed at HP Labs between 1985 and 1995 ... and now at Google.

    For C #, this is tessnet: Introducing the tessnet2 OCR library (C # language) .

    • one
      > ... and now on google. It lacks a sad smile : ( - - karmadro4

    The approach to solving the problem is initially incorrect. All you need is to get the contents of the window (the desktop is also a window). Quite a trivial thing.

    Here is a whole ready class for working with windows in Windows with an example of use.

      If I understand you correctly, then dig in the direction of image recognition algorithms.

      • five
        I already want to look at this software) Zagogulin is that if there are tits on the whole screen or say a green lawn - when the background is contrasted with the caption - then in principle the algorithms will work out. And if on the desktop there is a photo like "winter forest" - small white and black details, then the algorithm begins to see through there)) - SilverIce
      • one
        @SilverIce, this is another programmer argument for boobs. - Oleg Arkhipov