Hacker News

We built a tool to that makes it easy to create LLM UI automations for IOS and Android.

If You've ever tried to create tests that run with an LLM on mobile, probably encountered context problems due to the accessibility view being too long or just sending a screenshot to the LLM, which has low accuracy.

Cognisim:

1. Turns the accessibility into a more LLM parseable form for your agents, and uses set of mark prompting to combine the screenshot and text for more accuracy. We create a grid of the screen so the text representation also has some form of visual structure to it.

2. Implements a simple API to do interactions on IOS and Android

3. Maps LLM responses back to accessibility components via a dictionary that maps id -> accessibility component

Pretty simple, but we hope you get some value from it :)

We run CogniSim in production for thousands of mobile UI tests a day at Revyl. If you are interested in proactive observability - combining resilient end to end tests with open telemetry traces, give us a shout - revyl.ai

Comments URL: https://news.ycombinator.com/item?id=41968168

Points: 1

# Comments: 0

Article URL: https://github.com/jeromedalbert/rubocop-obsession

Comments URL: https://news.ycombinator.com/item?id=41968167

Points: 1

# Comments: 0

Article URL: https://www.morph-data.io/

Comments URL: https://news.ycombinator.com/item?id=41968125

Points: 1

# Comments: 0

Article URL: https://jackpoulson.substack.com/p/142-million-ai-drone-warfare-contract

Comments URL: https://news.ycombinator.com/item?id=41968124

Points: 1

# Comments: 1

Article URL: https://arxiv.org/abs/2410.08328

Comments URL: https://news.ycombinator.com/item?id=41968116

Points: 1

# Comments: 0

Article URL: https://twitter.com/levie/status/1850756866089034230

Comments URL: https://news.ycombinator.com/item?id=41968092

Points: 1

# Comments: 0

Article URL: https://github.com/eclipse/steady

Comments URL: https://news.ycombinator.com/item?id=41968083

Points: 1

# Comments: 0

Article URL: https://www.salomonmuriel.com/posts/meaning-of-wisdom/

Comments URL: https://news.ycombinator.com/item?id=41968047

Points: 1

# Comments: 0

finstruments is a Python library designed for modeling financial instruments. It comes with the core financial instruments, such as forwards and options, out of the box, as well as position, trade, and portfolio models. finstruments comes with the basic building blocks, making it easy to extend and build new instruments for any asset class. These building blocks also provide the functionality to serialize and deserialize to and from JSON, enabling the ability to store a serialized format in a document database. This library is ideal for quantitative researchers, traders, and developers who need a streamlined way to build and interact with financial instruments.

Comments URL: https://news.ycombinator.com/item?id=41968044

Points: 2

# Comments: 1

Hi everyone! I’m excited to introduce Trendly (trendly.global), an app I think you’ll find really useful.

Here’s what we’re solving: * Social media is full of fake news and lacks depth, yet many still rely on it for updates. * There’s too much content online, making it hard to find what really interests you. * Switching between platforms to get full details on a topic is tiring.

Trendly (https://trendly.global/) is a mobile app that curates a personalized feed with trending updates based on your interests. It lets you dive deeper by asking follow-up questions as a chat—all in one app.

We’re in the early stages, so while the chat function isn’t live yet, the other features are ready: * The feed acts as a recommendation engine, curating content based on past interactions. * Delivers concise, bullet-point summaries instead of lengthy articles * Pre-generated Q&A for easy understanding

Check it out and share your honest feedback!

Comments URL: https://news.ycombinator.com/item?id=41968041

Points: 1

# Comments: 0

Article URL: https://paravoce.bearblog.dev/how-do-you-deploy-in-10-seconds/

Comments URL: https://news.ycombinator.com/item?id=41968026

Points: 2

# Comments: 0

Article URL: https://zverok.space/blog/2024-10-21-global_functions.html

Comments URL: https://news.ycombinator.com/item?id=41968024

Points: 2

# Comments: 0

Article URL: https://www.thrillist.com/travel/nation/digital-nomads-criticism-locals-exploitation

Comments URL: https://news.ycombinator.com/item?id=41968008

Points: 12

# Comments: 3

Article URL: https://nitric.io/docs/guides/python/ai-podcast-part-1

Comments URL: https://news.ycombinator.com/item?id=41968006

Points: 1

# Comments: 1

Article URL: https://www.theguardian.com/books/2024/oct/25/letters-by-oliver-sacks-review

Comments URL: https://news.ycombinator.com/item?id=41967988

Points: 1

# Comments: 0

Article URL: https://www.smithsonianmag.com/smithsonian-institution/why-creator-first-lie-detectors-regret-invention-polygraph-machine-inventor-180985222/

Comments URL: https://news.ycombinator.com/item?id=41967979

Points: 1

# Comments: 0

Article URL: https://www.theregister.com/2024/10/28/microsft_branding_correction_site/

Comments URL: https://news.ycombinator.com/item?id=41967972

Points: 1

# Comments: 0

Article URL: https://ieeexplore.ieee.org/abstract/document/10184629/

Comments URL: https://news.ycombinator.com/item?id=41967912

Points: 1

# Comments: 0

Article URL: https://edu.anarcho-copy.org/Algorithm/grokking-algorithms-illustrated-programmers-curious.pdf

Comments URL: https://news.ycombinator.com/item?id=41967900

Points: 3

# Comments: 0

Article URL: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/418

Comments URL: https://news.ycombinator.com/item?id=41967897

Points: 1

# Comments: 0