u/inchenzo

Hi,

I got a little bit nostalgic when I was looking through all the videos I uploaded to Youtube. Asobi's made quite some progress in just 6 months.

To imagine that Asobi: Remote Play has gone from this https://www.youtube.com/watch?v=vGidddwYa98 to this https://www.youtube.com/watch?v=DpBgzYiGTSw

And now even with realtime Spatial conversion coming out: damn,. It's been quite the journey!

From the bottom of my heart, thank you! Thanks for all the support! Couldn't have done it without any of you!

Thanks,

/v

Hi!

I'd like to present to you some first impressions of a work in progress version of Asobi: Remote Play on Android. As you can see, I've been trying to match the look and feel of the iPhone/iPad version. Won't be long now!

More soon!

/v

p.s. The screenshots were taken on a Google Fold.

Hi,

I hope you all had a great weekend! Time for a new Sunday Report!

Let's get to it!

2D->3D Spatial conversion

The next big thing for Vision Pro is releasing in week 17, which is pretty big in my opinion. The user interface still needs a little bit of polish, but the tech's ready and working great!

If you have a Vision Pro you can actually see actual spatial screenshots and videos taken on device, which will be regularly updated and which you can visit here; https://asobiapp.com/spatial-3d.html

Also, If there's games you'd like to see added to the gallery, let me know and I'll see if I can find the time.

Speaking about the Spatial Gallery; I'm looking into making this also viewable on the Meta Quest.

One other thing is that I'll make sure to let you make your own screenshots and videos as well. However, my question to you is; would you be interested into sharing your in-game spatial memories via Asobi? I'm asking because I'm considering setting up a user gallery to where you can upload your taken spatial pics and videos. Let me know in the comments!

After the Vision Pro version of the spatial conversion has been released, I'll try to bring it the other Apple platforms as well, so you can hook up a 3D monitor or for instance Xreal Pro glasses to play your game in 3D as well.

Hopefully this will all also come to the other platforms, but can't commit to that yet. I need to know more about the devices first. Either way, I'm looking into it.

Performance Overlay

So I've made some much needed updates to the performance overlay, since this might help figure out what issues end users run into.

With the next update it'll shows the following;

- (Total) Total latency,
- (Net) Connection latency,
- (Visual) Visual latency,
- (Res) Stream resolution
- (RTT) Network round-trip time
- (DT) Hardware decode time per frame
- (FPS) Decoded frames per second
- (BT) Incoming stream bitrate
- (VL) Video packet loss %
- (Drops) Decoder queue drops

To me the main one of interest is the "Total Latency", since this is after all a remote play/cloud play client, and latency is what determines playability, and the goal is to keep it as low as possible.

So the first thing you'll notice is that latency differs per device, from networking, decoding to visually representing it on screen (GPU). So for instance local remote play on competition mode, my M5 Vision Pro had ~5ms but my M1 Pro Mac Mac sits at around ~8ms.

The latency mode doesn't only take the server latency in account but also the visual (glass to glass) latency, the total number represents the combined total. Which means it gives you real numbers instead of (what most do) only server latency. So you'll know where the issue lies.

Cloud

There's changes coming in for PS Cloud to make it connect faster and more reliable from anywhere in the world. This does however still mean that from certain countries you'll still have high latency since I have zero influence on the server location.

I've also managed to discover all PS Now and PS Cloud server locations, which would bring server selection a possible future addition.

More on all of this soon.

Ports

So next weekend we'll have a closed beta test for the ports of Asobi. To manage expectations; this will all mostly focus on the basics of the app, so you'll probably see no premium features in any of the closed beta ports.

Next to that, the closed beta will only be distributed via the store of each platform; so Windows + Linux via Steam, Android via Play Store and Meta Quest via the Meta Quest Store.

The focus of the test is all about basic stability and functioning, since I do expect bugs to show up or stuff to just not work.

Also, please be patient with me, since I'm doing all of this on my own and it's my first time publishing on Steam and Meta so there might be delays due to unforeseen circumstances. So bear with me!

Remote play

So there's a feature I can potentially add to Asobi in relation to Internet Remote Play; which kind of guarantees that you'll always be able to connect to your PS5 from anywhere. Downside is, it needs servers to run it and it induces some extra latency (around ~5ms).

I'm unsure if there's any interest in it. Which is why I'm here asking you guys. And the fact that it needs servers to run it, which means returning costs, which means -> I would have to setup a subscription for it.

What do you guys think? It's super low-priority for me currently, but I am curious what you think.

In closing

Either way Exciting times ahead! Next to getting in touch with some very important people, receiving some crazy offers for Asobi (I'm not selling). You might even see Asobi pop-up in unexpected places.

We're closing in to 1k members on our subreddit, the youtube channel is growing; it's crazy how far Asobi's come in less than 6 months.

Again, I just want to say; thank you all for all the support and trust you have in me and Asobi 🙇‍♂️🙇‍♂️🙇‍♂️. And keep reporting those bugs; It might not be named in this Sunday Report; but I'm working on it!

Be nice & game on! ❤️

/v

P.S. something green is coming. 👀

TLDR; Awesome stuff coming.

Hi,

I though I'd share this real quick. So the next update will have an updated performance overlay, and one of the things it now measures is latency.

With that I've finally managed to properly measure latency on each mode. And can finally confirm that "Competition" low latency mode is around ~9ms!

More soon!

/v

Hi!

So as most of you may know, I'm hard at work to bring Asobi: Remote Play to Windows, Android, Linux (SteamDeck) and Meta Quest.

Originally I had the intention to do a Play-test this weekend, except that I'e found some last minute changes I need to add to the ports in relation to cloud support. (the expanded library.)

The Play-test won't have any of the premium features; It'll cover basic Remote/PS Cloud play

To everyone that signed up; Thank you so much for your interest, the wait won't be much longer to try it out. You'll see invites show up around the time that the Play-test starts.

The Play-test is planned to run from: 24th of April from 12:00 CET - 27th of April 12:00 CET

There is however a chance that the Steam Play-test will run later, It's my first time publishing anything on Steam, so I might run into issue -> so bear with me.

There will be a reddit thread here where I'll ask you to put all your findings for whatever did and didn't work properly. More instructions about how to report anything (even if it's working great) will be explained in a post here next week.

When everything's done and finished then Asobi for these devices will be released on the Meta Quest, Steam and Play store. The release date's dependant on how well the Play-test
goes.

If you want to join;
Steamdeck/Windows: https://store.steampowered.com/app/4505440/Asobi_Remote_Play/
Android/Meta quest: Send me a DM with your email address and platform(s)

If you have any further questions -> let me know!

Thank you all for reading, I'll be in touch soon!

Have a great weekend!!!!

/v

P.S. Can't wait to get my hands on all the feedback! 🙏🙏🙏

Hi!

It's time for another Sunday Report! Got some really good stuff this week, made some really big strides. Especially for Vision Pro users.

So let's get straight to it!

Vision Pro

So with the update for week 15, I'll be introducing a windowed version of the immersive mode for Vision Pro, which means you'll get access to a really nice curved display with added light spill effect you can toggle. I really hope you guys will love this as much as I do.

But here's the thing, It's the scaffolding for something I've been working on for a while now. And that's LIVE 2D->3D spatial conversion. It works great and is performant with low latency gaming! I've decided to introduce 2 modes; Stereo and Spatial. The difference between these is mostly from a novelty sense as in that I'm confident most of you will only play via the Stereo mode because of one simple reason -> the game only exists on a 2D plane, which means it's content like an Apple TV 3D film or like those 3DTV's.

The spatial mode, is more for those curious about how it looks if you have more dimensional viewing of the content. Down side it that you can instantly see what limits there are. But hey, it's there; why not see it. (check the images in the post for previews, I've come quite a long way.)

Also, originally I had the plan to make special overlays for each game, which is why some time ago I asked people what games to support this. I noticed that drom most of my testing this might not be necessary at all although I am still exploring some tools to make the 3D more perfect which would help bring it to another level of quality compared to what it already is.

It looks great, and I can't wait for you all to get your hands on it. I expect it to be released with either version 1.2.1 or 1.2.2 of Asobi and there'll be no extra cost to use it.

I'll try sharing some previews and more info soon!

Performance

The idea for Asobi is to make Remote & Cloud Play as accessible as I can. Which is why with the next few update you'll see a better performance overlay which will be accessible at all times, more tools and more information on the website to alleviate your issues. One of the things in the next 2 updates will be indicators for connection issues and other warning in relation to degraded performance. This will help you and me to get to the bottom of issues faster and get Asobi to the next level.

PS Cloud

With 1.2.1 and 1.2.2 you'll notice some changes with PS Cloud and it's game list, the idea is that you won't have to add games manually anymore via the website so Asobi comes one step closer to not having to go to the PlayStation store to manually add games anymore.

This should make Cloud gaming much less of a burden for you.

Community

We're still growing strong, and I don't think it'll take long before we'll get to the 1k member milestone. I also love seeing your setups and trust me when I say I want to see more! Even gameplay if possible! I'll try to share some more as well, and will start making some walkthrough video's that covers everything from setting up and what's possible with Asobi.

I do have a question though, is there anything you'd like me to show? Bloopers? Stupid mistakes? More info? Anything you guys would like to see?

Also, if you guys have any suggestions on getting the word out about Asobi; I'm all ears! let me know! I love suggestions!

Either way thanks for all the support! 🙇‍♂️🙇‍♂️🙇‍♂️

The Ports

So the development of the ports is going well! All the platforms I'm testing on have arrived as you can see from the images with this post. The plan is to have a Playtest next weekend. Either way, more info will be shared in the coming week!

Other Projects

As you guys know there's also other projects that I'm working on; stuff like Midori (which is releasing very soon) and things like Wipeout on Vision Pro (which should also come to all the other Apple platforms soon), expanding it with Wipeout 2097/XL, but also other stuff that none of you guys know of as of yet. Thing like a native Plex and a native Spotify client for Vision Pro, stuff in gaming, and other crazy experiments. The thing is that most of these things have only been accessible to myself, which is a shame. I always believe you can make better products if you have proper feedback and support.

So what I'm considering is to maybe open up a Patreon where you can help with feedback, have direct influence on the product itself and have access to all the other crazy stuff I've been building behind the curtains.

Either way, you'll see a lot more coming this year apart from Asobi. It's going to be great!

So what am I asking of you? Well, to be frank; If there's any interest in this? Let me know in the comments or via DM.

One more thing (👀)

Since 2D->3D conversion is close to release, I'll make sure to also port this to the other Apple devices as well, so you'll be able to it on your old 3DTV or your 3D glasses like the XReal Pro.

Either way Exciting times! And there's still so much coming!

Enjoy the rest of your Sunday, I'll keep you guys posted! 🥳

/v

tldr: I'm making some awesome things for Asobi.

Hi!

So update 1.2 for Apple TV has a nice little feature to help people sign in to their PSN account!

Previously you had to have another Apple device to be able to sign-in to PSN on the Apple TV. which was quite the blocker for people without other Apple devices.

So now you can finally sign in from any device on Apple TV by scanning the QR Code shown on screen which will open up a web-helper on the asobiapp.com website to help you get the authenticated.

Should be available this week when 1.2 is available!

/v

Hi!

Victory! I survived my social obligations once more 🐰🐰🐰! (it was really fun though 🥳)
Either way I hope you all had a great weekend! A bit of a delay on my side in relation the the Sunday report, so for now it's Monday report time!

The Community

A big welcome to our 100 new members! It's crazy that it's only been a week and we've already grown again to the 700's! That and the fact that and we have our community interacting more, such as sharing your setup; I honestly am for these kinds of show and tell things. If you've got a cool setup, or have some in-game action to showoff on Asobi, then please share!

Update 1.2, "where is it?"

So originally I had planned to submit this update to Apple last Friday, but then thought -> it's going to be Easter, so this will probably take forever to get approved. So I delayed it to after Easter to make sure I can put a bit more time into developing it. I'm currently still testing it, since I want to make sure performance is still stable. There's been quite a few code optimisations and changes to the video pipeline. So expect to see a post tomorrow with the release notes.

April focus

The luxury of not using an existing codebase is that you can optimise it to the fullest instead of having to abide to opinionated software. The downside is however that there's still a lot of room to improve on the fundaments of the product since you're not taking the easy road.

Which means that the current focus for Asobi is general performance; making it generally perform better. This means that besides working on stuff like frame pacing and the general user interface and discovery of that, that I'll look into getting Asobi to perform better in general.

R&D

As you might've seen, I've been working on some strange stuff. Split screen remote play, Spatial conversion related stuff of getting Remote Play working on an Apple Watch among others.

Another thing I've been working on and which I now actually understand on how it works is 4-player local remote play; Which means that when/if I actually get it to behave means that you can remote play into your console and play local co-op games on one screen with multiple controllers (like Minecraft dungeons, It takes two and No way out), the downside is that from the looks of it this support will only come to PS4 consoles.

Other than that there's still loads to come. The idea is still for this to become the most feature complete Remote Play/Cloud platform for PlayStation.

Ports

Well, it's April so it's time to focus a bit more on getting the ports done. Most of the shared core is done, I just need to focus on porting the visual style of Asobi and make it's interface make sense for each platform. As always this is kind of stuff gets interesting as not everything will look great out of the box, so wish me luck.

As you might've seen, I posted this on r/remoteplay, If anyone want to join the playtest then follow the instructions of that post.

The general idea is that I'll have a limited Playtest in the weekend of the 18th for all the platforms with a potential release about a week later. I'm aiming for it to be from 17th till the 20th of April.

I also have some hardware coming in such as a Ally X and a Redmagic Astra which will hopefully help with making it look good for those types of handhelds

I've also added screenshots of the process on getting my custom decoder to work (I'm not going to be using FFMpeg), It's crazy that the latency on SteamDeck is almost non-existent, would be cool If I could bring some of this back to the Apple platforms as well.

Either way, more soon! sorry for the delays! I got some cool stuff coming

Peace ✌️, have a great week!

/v

P.S. for those wondering about Midori (/r/MidoriApp), I've re-submitted the Apple TV version to Apple, once that one's approved I'll be ready to release it!

Hi!

So although I have quite some announced and unannounced features coming to Asobi. I'm kinda curious if there's any stuff you would really like to see or want for the app. Or even stuff that you would like a solution to.

Things like; a more elaborate performance overlay, macro support, better tutorials etc.

Let me know; I might even have answers to if it's possible or not.

/v

Hi!

Time for a new Sunday Report!

I don't know how but every week seems to be quite a rollercoaster ride. But I did manage to finally get some rest! Haha.

So my highlight of last week? Being validated by streetpea (of chiaki, the open source remote play client) for not using their code and wishing me good luck with my app.
Why is that? It's been a thing for some people to make statements that hey can't back up with nothing else but some debug comments they found in my app. So streetpea and I got in touch and I offered him to look through my code and we discussed it. Which resulted in being validated. Something to celebrate for sure, since that's a confirmation from an official third-party! 🥳

I've also managed to writeup instructions for how to sync your PS Now save games, which can be found here. I'm still looking into being able to do that within Asobi itself, I'm close, but haven't found the definitive solution as of yet. It's a shame it's currently just myself working on this niche.

The Vision Pro is getting some extra love (as it should) with the next update (version 1.2), we finally managed to perfect the HDR colours. "Who's we?" you may ask, well I got some help of a key reddit member. And I want to thank him for all the time he put into this. So u/Maedarell thank you so much for helping out! (see screenshots for some of the stuff we did).

I've also made some great progress on low latency realtime 2D to 3D conversion for Vision Pro, so I don't think it'll be long before it gets released.

For those wondering what's keeping Midori (r/MidoriApp) from releasing? Well for one, I've been working hard and I needed to take it back a notch. I just have one last platform to be approved and when that's done it'll be released.

Last but not least, the ports to Meta Quest, Steam and Android. They're coming and I'm aiming to release them by the end of April.
Will there be any playtests? I don't know for certain yet, there might but depends on if I have the bandwidth before it get's released.
Will it have feature parity? To some extent, but don't expect everything to be 1:1 with the Apple versions.

Updates

Update 1.2.0 should be submitted to Apple this Wednesday/Thursday

These are some of the items that wil be released with 1.2

- Vision Pro HDR fix
- Mac bug-fixes
- Better Cloud support for unsupported countries
- PSN account sign in alert
- New zoom modes for iPhone: stretch/zoom to notch
- macOS native haptics over bluetooth

More next week! I got some cool stuff coming that's never been seen before!

Peace ✌️,

/v

P.S. Wow, we're already over 600 members strong at r/Asobi, thank you all for the fantastic support! It's humbling!

Hi!

Some of you might wonder where their saves have gone when playing on PS Now;

So here's a guide as to how to sync your PS Now save game (PlayStation 5 required)

1. Go to any streamable PlayStation 4 game (Example uses Killzone: Shadowfall
2. Click the stream button to start streaming
3. Wait for the game to start
4. When the game has started click the PS Button to show the card overlay
5. Click "Manage Saved Data"
6. Click "Ok" when it says that the application needs to be closed
7. Choose "Saved Data in Online Storage"
8. Click "Copy to Game Streaming Storage"
9. Click the game you want to select (you're also able to select multiple after clicking "option)
10. Select the data you want to copy to Game streaming storage and click "Copy"
11. Click "Yes" to initiate the copy, wait and then exit the menu by clicking circle until it exits
12. The game will start again and you'll now have access to your save!
13. Win!

Many thanks to u/h_a_p_p_i_e_r for pointing this out to me!

Enjoy!

/v

P.S. I've been working on triggering this menu, but haven't been able to find/send the right command yet to send to the server. So let's hope I figure this out soon!

Hi!

Time for a new Sunday Report!

So It's been a hectic week; Made Remote play work on an Apple Watch, released PS Now support, forgot to remove the debug flag to let people use it (sorry about that), announced the Android version, not getting enough sleep. That said, still a fantastic week!

And I'm really excited for all the stuff that's still coming. Also made great progress with live 3D conversion of the video stream for Vision Pro! And I still have a couple of surprises up my sleeve that are coming to the different platforms.

In relation to the ports to Meta Quest, Android and Steam. The plan is to have them released by the end of April. Also suggestions for a decent non-samsung android tablet is very welcome, so please let me know what's decent these days.

But yeah, I should get more sleep; this is what you get for being a solo developer 😂😂😂

Updates

Update 1.1.8 will be submitted to Apple tomorrow, so hopefully this'll fix issues with crashes on tvOS and macOS and add support for people not near the PS Now servers (just like we already have with PS Cloud)

These are some of the items that wil be released with 1.1.8 and some for later on;

- Internet Remote play updates
- Mac version bug-fixes
- PS Now updates so more people can use it
- Manual bitrate options for cloud streaming
- Better Cloud support for unsupported countries
- SDR/HDR color space updates
- Background streaming updates
- General user interface tweaks
- External monitor audio issues
- iPad UI updates
- PSN account sign in alert

More next week!

Peace ✌️,

/v

Hi!

So as some of you might've expected, Asobi: Remote Play is coming to Android. As you can see from the images I've attached to this post: This alpha build is running quite well on this old Google Pixel fold. I've got remote play and cloud play running. That said, there's still a lot to do, since it's not quite stable yet, and I'm not used to building user interfaces for it yet.

I'll share some more when there's more progress on this.

Enjoy your weekend!

/v

P.S. I'm aiming for an end of April release.