Apple Product Managers Discuss Cool New iPadOS 18 Features
With iPadOS 18, Apple added some useful iPad-specific features in the Notes app, including Smart Script and Math Notes. Both of these additions are designed to work with the Apple Pencil, and they're some of the neater new features on Apple's tablets. Apple product manager Ty Jordan and engineering manager Jenny Chen recently did an interview with Chris Lawley to discuss the work that went into the iPadOS 18 updates.
Smart Script is one of the ways that Apple is using machine learning in iPadOS 18. It refines handwritten text, making your handwriting look neater without losing the personal flare that makes it your handwriting rather than generic writing. Smart Script learns your handwriting style, which Jordan said makes it as useful as typed text.
You'll notice that as soon as you start writing words, it refines your handwriting. You'll notice that it spell checks, so if you make a spelling mistake, it'll be underlined. It can also do some really cool things with reflowing your text, so if you tap and hold your Pencil, you can move words around, and you'll see that it reflows in your paragraph so you can get some more space.
Smart Script learns continually and while it is designed to work quickly, it will get better over time as you write more, especially for features such as paste as handwriting. Recognition does not persist from note to note, however. Apple wanted the feature to feel personal and not like a font, which is why it refines dynamically with each note.
It's very contextual. So, for example, if you were to go to a previous paragraph where you had some band handwriting, we're going to match the handwriting that was refined there and not sort of try to replicate what you've had in other notes.
As for Math Notes, Jordan said that Apple took the time to "really reimagine" the calculator feature could be designed for the iPad's interface. If you're unfamiliar with the feature, Math Notes on iPad lets you write out equations with the Apple Pencil, with the Notes app solving the equation automatically when an equals sign is added.
It sort of works like magic. It combines the natural input of a pencil with the amazing on-device machine learning models that Jenny and her teams work on. You just write math like on a piece of paper and like magic, it just gives you the answer. It's so simple and intuitive.
Math Notes is able to recognize variables and the numbers associated with them. So if you define variables like price and area in one part of the note, and then write "price x area," Math Notes is able to provide an answer using the numbers specified earlier. Jordan explains:
I'll do my best shot and go back to high school. So a variable is just a named value, right? So you probably know a lot of them from school, like X and Y, and you could declare a variable with that [...] but you can do this with any word that you want.
Math Notes is intelligent enough to understand the difference between separate variables in a note, so if you have multiple math problems with the same variable like X, it won't get confused. You can have graphs added automatically in Math Notes if an equation can be grafted, which Chen says uses the work that Apple has previously done for the Swift Charts API.
Related Roundups: iOS 18, iPadOS 18
Related Forums: iOS 18, iPadOS 18
This article, "Apple Product Managers Discuss Cool New iPadOS 18 Features" first appeared on MacRumors.com
Discuss this article in our forums
https://www.macrumors.com/2024/07/17/apple-product-managers-discuss-ipados-18/
MacRumors /
npub1zy…hpp3a
2024-07-17 22:30:12
Author Public Key
npub1zywesxcqdhweaurfwgnp5n0qkqa9ueypv4c4tkqcvzp7nvjghgtskhpp3aPublished at
2024-07-17 22:30:12Event JSON
{
"id": "250546b4aaf5a822b84a92ed66644adcdd2d7ceae028fad430d8a087497b45c8",
"pubkey": "111d981b006ddd9ef06972261a4de0b03a5e6481657155d8186083e9b248ba17",
"created_at": 1721248212,
"kind": 1,
"tags": [
[
"guid",
"https://www.macrumors.com/2024/07/17/apple-product-managers-discuss-ipados-18/"
]
],
"content": "Apple Product Managers Discuss Cool New iPadOS 18 Features\n\nWith iPadOS 18, Apple added some useful iPad-specific features in the Notes app, including Smart Script and Math Notes. Both of these additions are designed to work with the Apple Pencil, and they're some of the neater new features on Apple's tablets. Apple product manager Ty Jordan and engineering manager Jenny Chen recently did an interview with Chris Lawley to discuss the work that went into the iPadOS 18 updates.\r\n\r\n\n\r\nSmart Script is one of the ways that Apple is using machine learning in iPadOS 18. It refines handwritten text, making your handwriting look neater without losing the personal flare that makes it your handwriting rather than generic writing. Smart Script learns your handwriting style, which Jordan said makes it as useful as typed text.\r\nYou'll notice that as soon as you start writing words, it refines your handwriting. You'll notice that it spell checks, so if you make a spelling mistake, it'll be underlined. It can also do some really cool things with reflowing your text, so if you tap and hold your Pencil, you can move words around, and you'll see that it reflows in your paragraph so you can get some more space.\r\n\r\nSmart Script learns continually and while it is designed to work quickly, it will get better over time as you write more, especially for features such as paste as handwriting. Recognition does not persist from note to note, however. Apple wanted the feature to feel personal and not like a font, which is why it refines dynamically with each note. \nIt's very contextual. So, for example, if you were to go to a previous paragraph where you had some band handwriting, we're going to match the handwriting that was refined there and not sort of try to replicate what you've had in other notes.\n\r\nAs for Math Notes, Jordan said that Apple took the time to \"really reimagine\" the calculator feature could be designed for the iPad's interface. If you're unfamiliar with the feature, Math Notes on iPad lets you write out equations with the Apple Pencil, with the Notes app solving the equation automatically when an equals sign is added.\r\nIt sort of works like magic. It combines the natural input of a pencil with the amazing on-device machine learning models that Jenny and her teams work on. You just write math like on a piece of paper and like magic, it just gives you the answer. It's so simple and intuitive.\n\r\nMath Notes is able to recognize variables and the numbers associated with them. So if you define variables like price and area in one part of the note, and then write \"price x area,\" Math Notes is able to provide an answer using the numbers specified earlier. Jordan explains:\r\nI'll do my best shot and go back to high school. So a variable is just a named value, right? So you probably know a lot of them from school, like X and Y, and you could declare a variable with that [...] but you can do this with any word that you want.\r\n\r\n\r\nMath Notes is intelligent enough to understand the difference between separate variables in a note, so if you have multiple math problems with the same variable like X, it won't get confused. You can have graphs added automatically in Math Notes if an equation can be grafted, which Chen says uses the work that Apple has previously done for the Swift Charts API.\r\n\r\nRelated Roundups: iOS 18, iPadOS 18\nRelated Forums: iOS 18, iPadOS 18\nThis article, \"Apple Product Managers Discuss Cool New iPadOS 18 Features\" first appeared on MacRumors.com\nDiscuss this article in our forums\n\nhttps://www.macrumors.com/2024/07/17/apple-product-managers-discuss-ipados-18/",
"sig": "2e0de2d51dfbc0d013685456f36e177dc2bf2a928489246a7315016bf8e37cb615e34ae874d902d4a0a10e4ca3ce6acc89d0fdb5af36f3fc239489a285801d17"
}