Type something to search...
OverRec: Tile Your Windows and Let AI Click and Type Inside a Rectangle

OverRec: Tile Your Windows and Let AI Click and Type Inside a Rectangle

Preparing a demo often means arranging a preview, reference material, and notes in one area. Asking an AI agent to help with a desktop task also requires a clear place to click and type. Two new OverRec capabilities connect those steps: Tile arranges multiple windows inside a rectangle, and simulated input lets an agent perform mouse and keyboard actions within a rectangle.

Set up the windows, define the interaction area, enter the content, and capture the result for review or a tutorial.

Tile: arrange several windows in one area

OverRec’s Snap feature moves and resizes a window to fit a rectangle. Tile divides that rectangle into slots and places selected windows into them. You choose the area, so a layout can occupy just the part of the desktop reserved for your work or recording.

LayoutA useful setup
Two columns: 1:1, 4:6, 6:4, 7:3, or 3:7Give the main app more space and keep references alongside it
Two rows with the same ratio choicesPut a preview above its output or notes
Three equal columns or rowsCompare three related windows
A 2×2 gridKeep four windows visible in the same area

Four demonstration windows arranged in an OverRec 2×2 grid

The colored test windows demonstrate the position and dimensions of each slot.

In the GUI, draw the target rectangle, open the Snap window list, choose a layout, select windows in the desired order, and click Tile. Slots fill from left to right, then top to bottom. Selecting fewer windows than slots leaves the remaining slots empty.

CLI and MCP workflows can use the same layouts. For example, list the windows, then place two of them in a 70/30 split in a specified area on monitor 0:

OverRec.exe cli window
OverRec.exe cli snap --windowid 657846,329812 --tile lr-7:3 --location 0,0 --size 1920x1080 --monitor 0

Replace the example IDs with actual IDs returned by window, and adjust the area to your display. Use lr-1:1:1 for three columns, tb-1:1:1 for three rows, or grid-2x2 for four quarters. The MCP snap tool also accepts a tile argument.

Simulated input: clicks and text inside the box

An agent can use OverRec’s MCP mouse and keyboard tools to interact within a defined area. Mouse actions include moving, clicking, double-clicking, dragging, and scrolling. The keyboard tool supports key combinations and text entry.

An AI agent enters and replaces text inside an OverRec rectangle over Notepad

The recorded demo clicks in Notepad, types text, then double-clicks a word and replaces it. The orange rectangle marks the interaction area.

This feature currently works on Windows. Input is sent directly to the window at the target point. Your real cursor stays where it is, and the foreground window and focus stay unchanged. With compatible applications, an agent can handle the task inside the rectangle while you work elsewhere.

Start the MCP server and connect an MCP client:

OverRec.exe cli mcp

The default HTTP endpoint is http://127.0.0.1:7820/mcp. Clients that manage the server process can instead launch OverRec.exe cli mcp --stdio.

A draw, click, and type workflow

Choose a rectangle inside the target application’s content area. This example shows the tools and arguments to call in sequence through an MCP client; adjust the coordinates to your actual window.

[
  {"tool": "draw", "arguments": {"x": 100, "y": 200, "width": 800, "height": 400, "monitor": 0, "timeout_secs": 120}},
  {"tool": "mouse", "arguments": {"overlay": 1, "action": "click", "x": 40, "y": 40}},
  {"tool": "keyboard", "arguments": {"overlay": 1, "x": 40, "y": 40, "text": "Hello from an AI agent!"}}
]

Replace overlay: 1 with the actual ID returned by draw. Mouse and keyboard coordinates are logical pixels relative to that rectangle’s top-left corner. The same MCP server process must create the rectangle; a box drawn in the GUI or by another server cannot be used as its input area.

Coordinates outside the rectangle are rejected before input is sent. Closing the overlay or letting it expire also ends interaction with it. Follow the actions with a screenshot of the same area to check the result.

Application compatibility

Simulated input works in application content areas that accept window messages. Games that read raw input and some UWP/WinUI applications may ignore it. Some applications do not recognize simulated modifier states. A non-elevated server cannot send input to elevated windows; Windows-key shortcuts are unsupported, and input is refused while the desktop is locked or a UAC screen is active. Title bars and window borders are outside the supported content area.

Try a click and a short piece of text before running a longer workflow. Tile prepares the workspace, simulated input performs the steps within the chosen area, and screenshots or recordings help you review the outcome and prepare demo material.

Get OverRec from the Microsoft Store, or visit the OverRec product page and CLI / MCP guide.

Related Posts

Learn Vocabulary Effortlessly with Infini Alchemy

Learn Vocabulary Effortlessly with Infini Alchemy

Are you looking for a fun and engaging game that can also help you learn new words? Look no further! Infini Alchemy is a creative alchemy game where you can combine basic elements like Water, Fire, Ea

read more
How to copy the formulas in ChatGPT response to word

How to copy the formulas in ChatGPT response to word

Copy the formulas in ChatGPT response to word, simply 3 steps:Copy the ChatGPT response as markdown (keep LaTeX formulas) Select the formulas in Word and insert as equation Convert LaTeX fo

read more
Master KET Vocabulary Through Alchemy: A New Learning Adventure

Master KET Vocabulary Through Alchemy: A New Learning Adventure

Infini Alchemy is an innovative web-based game that transforms vocabulary learning into an engaging alchemical adventure. By dragging and dropping elements to craft new items, players naturally absorb

read more
See the World Differently: Camera Effects in Sub Dimension

See the World Differently: Camera Effects in Sub Dimension

Your camera captures moments. Effects transform them into art. Sub Dimension comes packed with real-time visual effects that apply live in the viewfinder — what you see is what you get, whether you'r

read more
Real-Time Video Effects with GPU Acceleration

Real-Time Video Effects with GPU Acceleration

GPU rendering is now available in Sub Dimension Camera. This feature eliminates the need to wait for a video to "render" after recording. You can now preview and capture complex artistic filters in re

read more
longarm Is Now Available on Android

longarm Is Now Available on Android

longarm is now available on Android through Google Play. longarm turns an Android phone or tablet into a controllable remote endpoint for developers, testers, automation scripts, and AI agents. Start

read more

Move Any Window to an Exact Position and Size

You've set up a perfect workflow: your code editor on the left, browser on the right, terminal at the bottom. Then you restart your machine and spend the next five minutes dragging windows back into p

read more

Let an AI Agent Resize a Window and Take the Screenshot

Screen automation is easiest to trust when the result is visible and repeatable. In this short demo, an AI agent uses the OverRec screen skill to find a browser window, resize it to an exact rectangle

read more
How to Screenshot a YouTube Video (or Any Video Site) with OverRec

How to Screenshot a YouTube Video (or Any Video Site) with OverRec

You're watching a tutorial, a product demo, or a live stream and you want a clean frame from the video — no browser toolbar, no tab bar, no distractions. Here are two ways to do it with OverRec. ![Yo

read more
Record Any Screen Region to GIF or MP4 with OverRec

Record Any Screen Region to GIF or MP4 with OverRec

Screen recording usually starts with a compromise: capture the whole monitor and crop it later, or wrestle with a recorder's region selector every time. OverRec now records the exact rectangle you dra

read more
Meet Eidograph: A Geometry Workspace Built for AI Agents

Meet Eidograph: A Geometry Workspace Built for AI Agents

Asking an AI model to explain a theorem is easy. Asking it to build the actual figure is harder. A useful geometry agent must do more than return an image that looks plausible. It needs to create exa

read more
Give AI Agents Screen Control: OverRec's MCP Server

Give AI Agents Screen Control: OverRec's MCP Server

AI coding agents are good at reasoning about a task, but bad at touching the screen — finding a window, lining it up, and grabbing a clean screenshot has always meant gluing together ad-hoc scripts. O

read more
Eidograph Documentation Is Now Live

Eidograph Documentation Is Now Live

Eidograph now has a dedicated documentation site: eidograph-docs.metaphorprojects.link. Whether you are opening the app for the first time, trying a 3

read more
Run repeatable Android workflows with longarm batch tasks

Run repeatable Android workflows with longarm batch tasks

longarm now supports batch tasks: saved Android automation flows that can run more than one action at a time. Instead of sending a separate request for every tap, delay, app launch, or screenshot, yo

read more
Eidograph Is Now Available on Android

Eidograph Is Now Available on Android

Eidograph is now available on Android. It brings the same dynamic 2D and 3D geometry workspace to phones and tablets: const

read more
Every Eidograph Example Now Plays in Your Browser

Every Eidograph Example Now Plays in Your Browser

The Eidograph documentation now has a full library of ready-made geometry projects, and none of them require an install to look at. Every example carri

read more
Draw, Highlight, and Add Text Inside Your OverRec Rectangle

Draw, Highlight, and Add Text Inside Your OverRec Rectangle

A screenshot can show the problem. A circle around the right button and a short note can explain it. OverRec's new annotation tools let you add that context directly inside the rectangle you want to c

read more
AI + Word + Eidograph: How to Create Geometry Diagrams for Math Exams

AI + Word + Eidograph: How to Create Geometry Diagrams for Math Exams

Writing a math exam in Word often takes less time than drawing its diagrams. Vertex labels touch the edges, a midpoint drifts out of place, and a figure that looks fine on screen becomes hard to read

read more
Four Ways to Save OverRec Screenshots for Chats, Documents, and File Workflows

Four Ways to Save OverRec Screenshots for Chats, Documents, and File Workflows

What do you do after taking a screenshot? Paste it into a chat, keep the original for a bug report, or pass its file path to an editor or script? Each task calls for a different way to handle the capt

read more
Readpeater Is Now Available on Google Play

Readpeater Is Now Available on Google Play

Readpeater is now available on Google Play. The read-aloud practice app that started on Windows now runs on Android phones

read more
Tile App Windows Inside a Selected Area on Windows with OverRec

Tile App Windows Inside a Selected Area on Windows with OverRec

Sometimes you want two or three app windows neatly arranged in one part of your screen, with room alongside them for notes, a chat, or another task. A tutorial might need a fixed recording area. A com

read more

Mueve Cualquier Ventana a una Posición y Tamaño Exactos

Has configurado el flujo de trabajo perfecto: tu editor de código a la izquierda, el navegador a la derecha, la terminal abajo. Luego reinicias el equipo y pasas los siguientes cinco minutos arrastran

read more

Deja que un Agente de IA Redimensione una Ventana y Tome la Captura

La automatización de pantalla es más fácil de confiar cuando el resultado es visible y repetible. En esta breve demo, un agente de IA usa la habilidad de pantalla de OverRec para encontrar una ventana

read more
Graba cualquier región de la pantalla en GIF o MP4 con OverRec

Graba cualquier región de la pantalla en GIF o MP4 con OverRec

La grabación de pantalla suele comenzar con una concesión: capturar todo el monitor y recortarlo después, o volver a ajustar el selector de región de un grabador cada vez. OverRec ahora graba el rectá

read more
Cómo capturar un fotograma de YouTube (o cualquier sitio de vídeo) con OverRec

Cómo capturar un fotograma de YouTube (o cualquier sitio de vídeo) con OverRec

Estás viendo un tutorial, una demostración de producto o una transmisión en vivo y quieres capturar un fotograma limpio del vídeo — sin barra de herramientas del navegador, sin barra de pestañas, sin

read more
Da a los agentes de IA control sobre la pantalla: el servidor MCP de OverRec

Da a los agentes de IA control sobre la pantalla: el servidor MCP de OverRec

Los agentes de programación con IA son buenos razonando sobre una tarea, pero malos tocando la pantalla: encontrar una ventana, alinearla y obtener una captura limpia siempre ha implicado pegar script

read more
Conoce Eidograph: un espacio de geometría creado para agentes de IA

Conoce Eidograph: un espacio de geometría creado para agentes de IA

Pedir a un modelo de IA que explique un teorema es fácil. Pedirle que construya la figura real es más difícil. Un agente geométrico útil debe hacer algo más que devolver una imagen que parezca correc

read more
La documentación de Eidograph ya está disponible

La documentación de Eidograph ya está disponible

Eidograph ya tiene un sitio de documentación propio: eidograph-docs.metaphorprojects.link. Tanto si abres la aplicación por primera vez como si quiere

read more
Eidograph ya está disponible en Android

Eidograph ya está disponible en Android

Eidograph ya está disponible en Android. Lleva el mismo espacio de trabajo de geometría dinámica en 2D y 3D a teléfonos y t

read more

让 AI 智能体调整窗口大小并完成截图

屏幕自动化要让人放心,结果就必须可见、可重复。在这个简短演示中,AI 智能体使用 OverRec 屏幕技能找到一个浏览器窗口,将其调整到精确矩形,并在无需手动拖拽的情况下截取干净的截图。

read more

将任意窗口精确定位到指定位置和尺寸

你精心搭建了完美的工作流:左边代码编辑器,右边浏览器,底部终端。然后重启电脑,又花了五分钟把窗口一个个拖回原位——差不多,但就是不够准。 OverRec 解决了这个问题。手动拖拽窗口的局限 用鼠标拖拽窗口本来就不精确。你瞄准第 960 像素,落点却是 963。你把窗口调到"看起来差不多",却在一秒后发现那道缝隙。日常使用无所谓,但对于录屏、文档截图或需要重复使用的工作区布局

read more
如何用 OverRec 截取 YouTube 视频帧(或任意视频网站)

如何用 OverRec 截取 YouTube 视频帧(或任意视频网站)

你正在观看教程、产品演示或直播,想要截取一帧干净的视频画面——没有浏览器工具栏、标签栏,没有任何干扰。以下是使用 OverRec 的两种方法。方法一:在视频上绘制矩形,然后复用坐标 适合任何设备的最精确方法。使用 OverRec 的图形界面绘制一个精确覆盖视频播放

read more
使用 OverRec 将任意屏幕区域录制为 GIF 或 MP4

使用 OverRec 将任意屏幕区域录制为 GIF 或 MP4

屏幕录制通常需要做出妥协:要么录制整个显示器,之后再裁剪;要么每次都重新调整录屏工具的区域选择框。OverRec 现在可以直接录制你绘制的精确矩形,并沿用截图和窗口定位功能中已有的像素级精确工作流。 你可以从 OverRec 工具栏进行交互式录制,也可以通过命令行自动执行定时录制。输出格式支持动态 GIF 和 H.264 MP4。从图形界面录制精确区域 可视化录制流程非常简

read more
让 AI Agent 直接控制屏幕:OverRec 的 MCP 服务器

让 AI Agent 直接控制屏幕:OverRec 的 MCP 服务器

AI 编程智能体擅长推理任务,但并不擅长真正操作屏幕: 找到一个窗口、把它摆正,再截出一张干净的图片,过去往往需要拼接一堆临时脚本。OverRec 通过作为 Model Context Protocol(MCP)服务器运行,填补了这道缺口。这样一来,无论是 Claude Code、Claude Desktop,还是你自己的工具

read more
认识奕图:为 AI 智能体打造的几何工作空间

认识奕图:为 AI 智能体打造的几何工作空间

让 AI 模型解释一个定理很容易,让它真正构造出定理中的图形却要困难得多。 一个实用的几何智能体不能只返回一张看起来合理的图片。它需要创建精确对象、保留依赖关系、发现无效命令、修正自己的工作,并留下可供人检查和继续编辑的构造。 奕图 是一款围绕这套流程设计的全新动态几何工作空间。可视化画布与纯文本构造语言是同一图形的两种视图,因此人工编辑与智能体编辑会汇入同

read more
奕图文档站正式上线

奕图文档站正式上线

奕图现在有了专属的文档站:eidograph-docs.metaphorprojects.link。 无论你是第一次打开应用、想尝试 3D 构造、需要查找一条 Eidolang 命令,还是准备接入 AI Agent,现在都可以在一个结构清晰的网站中找到答案。 ![奕图工作空间中的几何构造及与其同步

read more
Eidograph 现已上线 Android

Eidograph 现已上线 Android

Eidograph 现已上线 Android。它将同一套动态 2D 与 3D 几何工作区带到手机和平板电脑:你可以直接在画布上构造、编写 Eidolang 脚本,或在同一图形的两种视图之间切换。 当一个几何任务开始于问题而非图示时,Androi

read more
Dibuja, resalta y añade texto dentro de tu rectángulo de OverRec

Dibuja, resalta y añade texto dentro de tu rectángulo de OverRec

Una captura puede mostrar un problema. Un círculo alrededor del botón adecuado y una nota breve pueden explicarlo. Las nuevas herramientas de anotación de OverRec permiten añadir ese contexto directam

read more
在 OverRec 的矩形内直接勾画、高亮和添加文字

在 OverRec 的矩形内直接勾画、高亮和添加文字

截图能展示问题,而圈出按钮、补上一句说明,往往能让问题更容易理解。OverRec 新增的标注工具,让你直接在准备截取的矩形区域内完成这些说明。 你可以自由勾画、框出控件,或在画面上添加文字,调整颜色和透明度,在会议共享屏幕时展示这些标注,也可以截取一张带标注的图片。整个过程都围绕原来用于精确截图的矩形展开。 上面的截图展示了用 OverRec 标注这篇文章的效果:给单词加上半透明高亮、画出下划

read more
AI + Word + 奕图:怎样制作数学试卷中的几何图形

AI + Word + 奕图:怎样制作数学试卷中的几何图形

在 Word 里编数学试卷,题干往往很快就能写好,几何图却要反复调整:顶点字母碰到线段,中点偏了,缩小以后标注看不清,改一道题又得重新画。 可以把这件事拆成三个环节:AI 把题目条件转成构造要求,奕图(Eidograph)建立并导出几何图,Word 负责试卷排版。 图形的点、线和关系保留在可编辑项目里,下一次改题时仍能继续使用。 下面以这道题为例,走完从题干到可打印图形的流程:

read more
OverRec 截图怎么保存?用四种组合衔接聊天、文档和文件工作流

OverRec 截图怎么保存?用四种组合衔接聊天、文档和文件工作流

截图之后,你下一步要做什么?把图片贴进聊天窗口、为问题报告留一份原图,还是把文件路径交给编辑器或脚本?不同任务需要不同的截图输出方式。 OverRec 的截图设置提供三个选项,让你在截取同一个区域时,按后续操作选择合适的组合。少一次打开文件夹、查找图片或复制路径,就能让连续截图的过程顺畅一些。 先认识三个选项 截图中的 Screenshot 设置区包含:**Save t

read more
Cuatro formas de guardar capturas de OverRec para chats, documentos y trabajo con archivos

Cuatro formas de guardar capturas de OverRec para chats, documentos y trabajo con archivos

¿Qué haces después de tomar una captura? ¿Pegas la imagen en un chat, guardas el original para un informe de errores o pasas la ruta del archivo a un editor o a un script? Cada tarea necesita una form

read more
OverRec: organiza ventanas con Tile y permite que la IA haga clic y escriba dentro de un rectángulo

OverRec: organiza ventanas con Tile y permite que la IA haga clic y escriba dentro de un rectángulo

Preparar una demostración suele requerir colocar una vista previa, las referencias y las notas en una misma zona. Para que un agente de IA ayude con una tarea de escritorio, también necesita un lugar

read more
OverRec 新能力:用 Tile 平铺窗口,让 AI 在矩形内点击和输入

OverRec 新能力:用 Tile 平铺窗口,让 AI 在矩形内点击和输入

准备一段演示时,你可能需要把预览、参考资料和笔记摆进同一块区域;让 AI 帮忙操作桌面时,又希望它能在指定位置点击、填写文字。OverRec 最新的两项能力,把这些步骤接在了一起:Tile 将多个窗口平铺到一个矩形中,模拟输入则让 AI 在矩形内执行鼠标和键盘操作。 你可以先安排窗口,再划定操作区域,完成输入后截图检查,或将演示录成视频。 Tile:一个矩形,安排多个窗口 Ov

read more