Reading color from a Bitmap obtained using DirectX

Question

There is a task to read the pixel color from the BMP file, which is placed in image1 . It is necessary to use for reading the TMemoryStream file, since there is no possibility to use image1.Canvas.Pixels[x,y] - the “pipette” is disabled when the DirectX application is running, but it is also started from BMP and taken as a screenshot.

Addition!!!

It turned out that - taking the color Bitmap.Pixels began to work once every other time. What could be the problem? In general: I compile the application, run it from the имена админа - PostMessage does not work, the color returns zeros. I close the application. I start it on a new one - and that works. And so all the time. Previously, the same behavior was noticed in the TICQ module - I didn’t want to log in once every time I started it. What could it be? As you can see, I do not edit the code between runs , and I do not even compile . Just restart and either everything works or everything does not work. I have a Delphi XE3 and Win10 .

So. The code sections do not always work ( I run on имени админа ), but sometimes they work when the application is repeatedly restarted :

 procedure TForm1.F10Timer(Sender: TObject); var wnd: HWND; begin wnd:=FindWindow(0, 'Lineage II'); //находим окно if (wnd<>0) then //если найдено то выполняем код (находит всегда) begin PostMessage(wnd,WM_KEYDOWN, VK_f10,0); //нажимаем F10 label14.Caption:='F10'; //для себя пишем на форме что клавиша нажата end; end;

There are many such procedures, they are identical, and all together or work or not. They actually send keystrokes to the game window (yes, I am writing a bot).

Next is the definition of color. It only works if sending keystrokes works (I mean this bug, which I described above):

 procedure TForm2.Button5Click(Sender: TObject); var GetSc:Dx.TImageCatcher; begin GetSc:=Dx.TImageCatcher.Create; //создаю экземпляр класса (Dx.pas) GetSc.TargetHandle:=FindWindow(0, 'Lineage II'); //передаю заголовок игры GetSc.CatchType:=ctDirectX; //установил способ съемки GetSc.ActivateTarget; //активирую окно игры GetSc.GetScreenShot; //это битмап, сюда грузим снимок image1.Picture.Bitmap:=GetSc.Bitmap; //из битмапа передаем снимок в image1 image1.canvas.CopyRect(image1.ClientRect,image1.Canvas,rect(27,58,181,95)); //оставляю в image1 только интересующую меня область (шкала CP, HP, MP) image1.Picture.bitmap.width:=155; //ровняем размеры image1.Picture.bitmap.Height:=38; //ровняем размеры image1.Picture.Bitmap.Dormant; //переводим image1 по совету из камментов labelededit1.Text:=inttohex(image1.Picture.Bitmap.Canvas.Pixels[135,19],6); //пробуем узнать цвет end;

In fact, here is the whole example, everything else is similar. There is an opinion that either the compiler is sinning or WinAPI, I can not understand. This all sometimes works great, if you start working, and the result here is it:

Window link: https://drive.google.com/open?id=0B3g0HJYW_bzHcnNHWEtTMDVxdXc

Lineage II in the list of windows. Window "Lineage II" class "L2UnrealWWindowsViewportWindow". We see no children.

Link: https://drive.google.com/file/d/0B3g0HJYW_bzHNU1LX3lqWDlfZ2M/view?usp=sharing

Addition: when DirectX running, taking a pixel color from a point on the screen or from image1 using the above method returns the color code 000000 to hex .
You did not show the code that captures the image in the image.
Try to make image1.Picture.Bitmap.Dormant - this converts the bitmap to DIB, and then get access through image1.Picture.Bitmap.Canvas.Pixels .
The location of the bytes of a particular pixel depends on the bitmap bit depth and other factors.
So with the help of a method from another unit I load it into an image : image1.Picture.Graphic:=GetSc.Bitmap;
GetSc.Bitmap is a method from a unit with which I use DirectX pull an image out Z-буфера game's Z-буфера .
When it is launched, the screen does, I execute Dormant , but instead of color in the end, 000000 .
I already broke my whole head, I can’t even imagine what to do with it and why.
Here is the screenshot of drive.google.com/file/d/0B3g0HJYW_bzHcnNHWEtTMDVxdXc ... ... Where the HP bar is HP I'm trying to get the color of the dot.
These two images fly into image1 and image2 from DirectX .
As seen in LabeledEdit "Color HP" - instead of color zeros.
I close the game and try to screen any other window - the color is correct.

Accepted Answer · 2016-02-08T12:35:02

Try this:

 GetSc := Dx.TImageCatcher.Create; //создаю экземпляр класса (Dx.pas) try GetSc.TargetHandle := FindWindow(0, 'Lineage II'); //передаю заголовок игры GetSc.CatchType := ctDirectX; //установил способ съемки GetSc.ActivateTarget; //активирую окно игры GetSc.GetScreenShot; //это битмап, сюда грузим снимок image1.Picture.Bitmap := GetSc.Bitmap; //из битмапа передаем снимок в image1 finally GetSc.Free; end; image1.ScanLine(0); // дальше можно работать с указателем на массив пикселей, полученным от функции ScanLine или делать как раньше image1.canvas.CopyRect(image1.ClientRect,image1.Canvas, rect(27,58,181,95)); //оставляю в image1 только интересующую меня область (шкала CP, HP, MP) image1.Picture.bitmap.width:=155; //ровняем размеры image1.Picture.bitmap.Height:=38; //ровняем размеры labelededit1.Text:=inttohex(image1.Picture.Bitmap.Canvas.Pixels[135,19], 6); //пробуем узнать цвет

I added your edits, but unfortunately it had no effect on the situation.
Today from the time of the 20th I made it all work = (PS: I mean, I restarted the application 20 times until it worked
Now I put 10 Seattle, there is an opinion that my version of XE3 is sinning
Installed a new Delphi, deleted the compiled file, re-compiled it at 10 Seattle and ... nothing.
Therefore, I came to the point that you need to try to take the color in hex from the file.

Reading color from a Bitmap obtained using DirectX

1 answer 1

More articles: