Creating a mouse click simulation, in windows development

johanan · July 5, 2018 at 9:16 AM

For development, I am trying to simulate a mouse click on emWIn Windows simulation.
It works fine on the embedded device, but will make it much easier for development if I can simulate on my pC.
I tried this, but it does not work.

Code

int xpos_ = 0,ypos_ = 0;


int GUI_TOUCH_X_MeasureX(void) { 
	return xpos_;
}


int GUI_TOUCH_X_MeasureY(void) {
	return ypos_;
}	
void doMouseCmd()
{
    xpos_ = getXpos();
    ypos_ = getYpos();


	printf("Processing Mouse cmmd x= %d  y = %d\n\n\n",xpos_,ypos_);
	GUI_TOUCH_Exec(); // get x
	GUI_TOUCH_Exec(); // get y
}

Display More

Any idea how to accomplish this?
Thanks.

SEGGER - Schoenen · July 9, 2018 at 2:51 PM

Hi,

Try using the function GUI_PID_StoreState(). Simply fill the GUI_PID_STATE structure, passed along with this function, with the desired coordinates and if a press or unpress event occurs.

For a click the unpress event should happen on the same position as the last down event.

Below is an example, on click or release of the upper button a GUI_PID_STATE structure gets filled and passed to emWin. Since the up and down events occur inside the second button, it gets pressed and released.

C

#include "DIALOG.h"


/*********************************************************************
*
*       Static code
*
**********************************************************************
*/


/*********************************************************************
*
*       _cbBk
*/
static void _cbBk(WM_MESSAGE * pMsg) {
  int Id;
  int NCode;
  static GUI_PID_STATE State;


  switch (pMsg->MsgId) {
  case WM_PAINT:
    GUI_SetBkColor(GUI_BLACK);
    GUI_Clear();
    break;
  case WM_NOTIFY_PARENT:
    Id    = WM_GetId(pMsg->hWinSrc);
    NCode = pMsg->Data.v;
    if (Id == GUI_ID_BUTTON0) {
      switch (NCode) {
      case WM_NOTIFICATION_CLICKED:
        State.x = 50; // x middle of the other button
        State.y = 50; // y middle of the other button
        State.Pressed = 1;
        GUI_PID_StoreState(&State);
        break;
      case WM_NOTIFICATION_RELEASED:
        //
        // x and y do not change but the pressed state
        //
        State.Pressed = 0;
        GUI_PID_StoreState(&State);
        break;
      }
    }
    break;
  default:
    WM_DefaultProc(pMsg);
    break;
  }
}


/*********************************************************************
*
*       Public code
*
**********************************************************************
*/
/*********************************************************************
*
*       MainTask
*/
void MainTask(void) {
  WM_HWIN hItem;


  GUI_Init();
  //
  // Set callback to manage the background
  //
  WM_SetCallback(WM_HBKWIN, _cbBk);
  //
  // This button causes a simulated mouse click on the second button
  //
  hItem = BUTTON_CreateEx(10, 10, 80, 20, WM_HBKWIN, WM_CF_SHOW, 0, GUI_ID_BUTTON0);
  BUTTON_SetText(hItem, "Click me");
  //
  // This button will get pressed when pressing the other button.
  //
  BUTTON_CreateEx(10, 40, 80, 20, WM_HBKWIN, WM_CF_SHOW, 0, GUI_ID_BUTTON1);


  while (1) {
    GUI_Delay(100);
  }
}

Display More

Regards,
Sven

johanan · July 10, 2018 at 9:12 AM

Thanks Sven,
I tried your code and it works OK with simulation, but my code does not.
Should I call GUI_PID_StoreState() only inside the callBack function?

My code is simple but in another thread (FreeRtos, but only one task calling GUI_EXE)
any idea why it does not work?

Code

void doMouseCmd( char * dPtr)
{
	 GUI_PID_STATE State;
	// 4 bytes are x, 4 bytes are y
	State.x = ptrToInt(dPtr,2);
	State.y = ptrToInt(dPtr+4,2);
	printf("\nProcessing Mouse cmmd x= %d  y = %d\n",State.x,State.y);
        State.Pressed = 1;
        GUI_PID_StoreState(&State);
        State.Pressed = 0;
        GUI_PID_StoreState(&State);


}

Display More

Regards,

SEGGER - Schoenen · July 10, 2018 at 9:39 AM

Hi,

You are passing a pressed and unpressed event directly after each other. On my end this is working but it will look like nothing happens. The only thing visible is that the button gets the focus.

Try to perform a delay between the pressed and unpressed change in your other thread (not a GUI_Delay() one of your OS).
Then it should become visible. Like in the code below.

Also try to set breakpoints on both 'NCode = 0' in _cbBk(). Then you should run on them. First on the clicked and then on released event.

C

#include "DIALOG.h"
/*********************************************************************
*
*       Static code
*
**********************************************************************
*/
/*********************************************************************
*
*       _cbBk
*/
static void _cbBk(WM_MESSAGE * pMsg) {
  int Id;
  int NCode;


  switch (pMsg->MsgId) {
  case WM_PAINT:
    GUI_SetBkColor(GUI_BLACK);
    GUI_Clear();
    break;
  case WM_NOTIFY_PARENT:
    Id    = WM_GetId(pMsg->hWinSrc);
    NCode = pMsg->Data.v;
    if (Id == GUI_ID_BUTTON0) {
      switch (NCode) {
      case WM_NOTIFICATION_CLICKED:
        NCode = 0;
        break;
      case WM_NOTIFICATION_RELEASED:
        NCode = 0;
        break;
      }
    }
    break;
  default:
    WM_DefaultProc(pMsg);
    break;
  }
}


/*********************************************************************
*
*       _DoMouse
*/
static void _DoMouse(void) {
  GUI_PID_STATE State;


  State.x     = 50;
  State.y     = 20;
  State.Layer = 0;
  State.Pressed = 1;
  GUI_PID_StoreState(&State);
  YourRTOS_Delay(1000);
  State.Pressed = 0;
  GUI_PID_StoreState(&State);
}


/*********************************************************************
*
*       Public code
*
**********************************************************************
*/
/*********************************************************************
*
*       MainTask
*/
void MainTask(void) {
  WM_HWIN hItem;
  GUI_Init();
  //
  // Set callback to manage the background
  //
  WM_SetCallback(WM_HBKWIN, _cbBk);
  //
  // This button causes a simulated mouse click on the second button
  //
  hItem = BUTTON_CreateEx(10, 10, 80, 20, WM_HBKWIN, WM_CF_SHOW, 0, GUI_ID_BUTTON0);
  BUTTON_SetText(hItem, "Click me");
  while (1) {
    GUI_Delay(1000);
    _DoMouse();
  }
}

Display More

Regards,
Sven

johanan · July 10, 2018 at 10:49 AM

Working !!
Thanks very much.
I use FREERtos queue inside the call back routine, I find this to be stable, if it helps anyone:

C

static void cbScreen(WM_MESSAGE * pMsg) {
	int i;
	char * barMsg;
	TGuiQdata guiMSg ;
	WM_HWIN  hItemNear;
	GUI_PID_STATE remMouse;
	GUI_PID_STATE * pState;
	if(remoteMouseQue != NULL)
	{
	  if(xQueueReceive(remoteMouseQue, &remMouse , 0) )
	 {
			remMouse.Pressed = 1;
			GUI_PID_StoreState(&remMouse);
		//	vTaskDelay(10);
			remMouse.Pressed = 0;
			GUI_PID_StoreState(&remMouse);
	  }


	}
	switch (pMsg->MsgId) 
	{


	case WM_INIT_DIALOG:
		initScreenObjects(pMsg);
.
.
.

Display More

Johanan

Participate now!