ChromeOS users already have access to hundreds of thousands of Android games via Google Play, but many of these games are not yet optimized for keyboard and mouse use. Beginning with ChromeOS 105, we’re introducing an early Alpha of the game controls feature for a select set of touchscreen-only Android games. The game controls feature translates key presses into simulated touch events, bridging the gap for touchscreen-only games.
Keyboard support is critical for ChromeOS; approximately 90% of ChromeOS users interact with apps using a mouse and keyboard, but many apps from Google Play are only designed with touch interactions in mind. It’s an especially important problem for games, which often require quick movements or button taps that are difficult or impossible to perform with a mouse. By translating key presses into simulated touch events, the game controls feature allows players to use their keyboard to interact with on-screen buttons and virtual joysticks, resulting in a vastly improved experience for games with limited or missing keyboard support.
The new game controls feature can rapidly improve the gaming experience, particularly for ChromeOS devices without a touch screen. It doesn’t replace the existing need for developers to implement keyboard support in their apps, though. To provide the best and most consistent gameplay across phone, tablet, desktop, and large-screen devices, we recommend developers support a breadth of input modes, including mouse, keyboard, and gamepads. We see game controls as a way to overcome initial challenges with the ChromeOS gaming experience while users wait for developers to fully optimize their apps for ChromeOS.
For the Alpha release, we’re introducing the most necessary elements to enable keyboard support on a handful of pre-selected games. This includes the ability to customize key assignments, show/hide the key overlay, and disable the game controls feature on a given game. This all lives within the game controls menu displayed within a supported app. The game controls feature is available on any device running ChromeOS 105 or later and is connected to both a keyboard and an input pointer device (such as a mouse or touchpad).
When first opening a game with game controls support, there will be an overlay showing the keys you can use to simulate various touches on screen via the keyboard. Currently, game controls can send keyboard input as tap actions and simulate touch-and-drag interactions commonly used for on-screen virtual joysticks/dpads. You can customize the key bindings via the game controls menu, which you can access by clicking the white square hovering on the right center portion of the game’s window.
This release is intended for use in active gameplay. You should still use your mouse for menu navigations and in-game dialogs. It doesn’t address existing strange behavior some games have in certain window sizes or when resizing.
For the initial release, we handpicked a collection of games that we hope will reach a wide range of ChromeOS gamers. The categories we focused on were: joystick, single button, multi-button, and swipe games.
This is just the beginning! We will be adding an editor to make adding game controls support possible for any game from Google Play that your Chromebook runs, mouse and gamepad support, handling more types of touch interactions, plus more! Have any games or requests you want to see prioritized? Submit your ideas via the Send Feedback button in the hovering menu on any game where game controls are enabled.
Source: 2022 Google Internal Data ↩︎