Show HN: Gaussian Splat of a Strawberry | Hacker News

Show HN: Gaussian Splat of a Strawberry (superspl.at)

530 points by danybittel 21 days ago | hide | past | favorite | 200 comments The Setup:https://i.imgur.com/o0hgybh.jpeg https://i.imgur.com/mcNiomp.jpeg https://i.imgur.com/vIjw6pc.jpeg https://i.imgur.com/nzOwmSC.jpeg

| ovenchips 21 days ago | next [–] I built PlayCanvas in 2011 to power video games. Here we are in 2026 and it's powering strawberries.

| ovenchips 20 days ago | parent | next [–] For anybody interested, SuperSplat (and PlayCanvas) is open sourced on GitHub: https://github.com/playcanvas

| dormento 21 days ago | parent | prev | next [–] Thank you for your service!This is one of the most endearing things about open source IMHO, the way people can find novel uses for it.

| ovenchips 20 days ago | root | parent | next [–] I completely agree with you. I'm constantly bowled over by the creativity of the SuperSplat/PlayCanvas communities.

| ivolimmen 21 days ago | prev | next [–] Wow this is a time killer... ended up here: https://superspl.at/scene/ff1d0393 beautiful!

| data-ottawa 21 days ago | parent | next [–] It’s amazing this runs perfectly smooth on my iPhone 12 miniThat is indeed a very cool scene being about to wander around and still have decent resolution

| lopsotronic 21 days ago | root | parent | next [–] Ah the timeless joy of falling through the floor geometry.Seriously though - it's breathtaking.The first guy who figures out the bridge between splats and dynamism - animation, editing, responsiveness - is going to be one of the immortals of 3d design.

| mrandish 19 days ago | root | parent | next [–] If you don't mind a basic but tangential question... I understand that splats like these are essentially a separate domain from traditional polygonal 3D scenes in a tool like Blender, but is it currently possible to use splats like the strawberry as elements in a Blender scene if they don't animate or interact any more than the camera / lights moving and being occluded by foreground objects?Remembering how we used to cheat by projecting hi-res texture maps onto simple geometry to save modeling background objects with the trade-off of constraints on size, viewing angle, shadows, etc. With the relative ease of capturing these splats at high-fidelity, can they be used in a scene as projection-map-like 'fakes' except with far fewer constraints?

| Intralexical 17 days ago | root | parent | next [–] They're basically light fields, so even though they don't represent any geometry, you could easily integrate them into the rendering pipeline at the path tracing/rasterization stage for Cycles/EEVEE.I think the "right" way to do it without forking Blender would be to write an OSL shader. Though the way I personally would have done it would be to convert the splat into an angle-dependent Math Node tree for an Emission shader, probably automatically with a Python script.Trouble is light fields don't block geometry, so they would effectively blend additively and you would see right through them like a hologram. Easy enough to fix though, with a dummy mesh to composite out the background. Or you could just render the splat separately outside Blender, and composite your scene on top of it.I'm not sure why you would want to, though. The splats couldn't be lit by any of the lights in your scene, nor can they receive shadows cast by any objects in your scene, because they're precomputed light fields. Objects in your scene could be lit by the splats, but it's not immediately clear to me that it would be much more useful or better than just having photos on billboard planes.I think there might be a misunderstanding that splats provide a way to compute realistic lighting. In reality, they're only a way to store and sample pre-computed or measured lighting AFAIK, hence the need for OP's big camera rig. So integrating them into scene lighting or skeletal animation doesn't really apply.

| cubefox 20 days ago | root | parent | prev | next [–] There are many ways to represent 3D data, but animations really only work properly with polygon meshes (e.g. triangle surface meshes or volumetric tetrahedral meshes).

| lopsotronic 20 days ago | root | parent | next [–] But the mesh is itself an abstraction, you just need to build that bridge.We've been leaning away from pure polygons for decades, anyway. Vertex skinning, SDFs, volumetrics, simulation, and a lot more.The meshes in a From Software game are for exmple hilariously simple, most of the animation is force simulation to make the famous "frizzles" that they like.

| cubefox 20 days ago | root | parent | next [–] Vertex skinning is essential for animation and it only works with polygons.

| lopsotronic 20 days ago | root | parent | next [–] I'm not sure that's completely accurate? Vertex skinning isn't (necessarily) tied to polygons . . but to having points (or any parameterized features) that can be transformed by a weighted blend of matrices.The "vertex" in "vertex skinning" is really just "a thing with a position that gets moved."p' = Σ wᵢ · Mᵢ · pIt's just a position. Triangles can come along for the ride downstream, but they're not essential, which is one of the reasons it's so efficient for some stuff. Polygons are the optimal surface - but surfaces are often extraneous.Take all this a few hefty grains of salt, I'm an amateur in the field. My 3d/CAD work is strictly in support of my enterprise stuff. And making wicked battlemaps for gaming VTTs, natch.But I will stand by the overarching statement that polygons are in fact an abstraction, and bridging that abstraction with whatever is in splats would be wicked awesome.

| data-ottawa 20 days ago | root | parent | prev | next [–] I don’t know. Maybe today, but tomorrow?If you can sample points inside a volume, in theory you could do that with splat geometry. If someone figures out a way to pass in animation time to a sampler, sample along geometry/wireframe or something else, and keep it from overly twinkling it might change everything.I’m hand waving all the complexity into “if done one figures out”, of course.I just don’t see why this method can’t evolve in the way diffusion models have evolved (knowing very little of the geberative mechanics of splats).

| cubefox 20 days ago | root | parent | next [–]

If someone figures out a way to pass in animation time to a sampler, sample along geometry/wireframe or something else, and keep it from overly twinkling it might change everything.Not sure that's what you mean, but there was recently a paper where they put meshless (e.g. voxel or SDF) geometry in an animated tetrahedral mesh "cage" and then animate the meshless model by animating the mesh cage:https://diglib.eg.org/server/api/core/bitstreams/bd94e19b-98...https://youtube.com/watch?v=6lKAvxV2mno https://youtube.com/watch?v=3c3-ue-fd88Though this currently isn't compatible with 3DGS if I understand the limitations section correctly.> Finally, our method operates unordered, limiting its suitability for complex volumetric effects. However, a potential solution lies in sorting the generated intervals for proper blending. This enhancement could improve our approach’s compatibility with various meshless representations, such as radiance fields and volumetric lighting.

| Intralexical 20 days ago | root | parent | prev | next [–] Since splats sample the light field after surface reflection, you can't do realtime shading with splats the way you can with raytracing and rasterization. I guess it could be animated like a holographic movie, but not like a video game and not like a 3D editor, because the light for all angles in all frames has to be precomputed.

| db48x 20 days ago | root | parent | prev | next [–] It’s easy but a bit data intensive. Take two 3D splat images at different times, optimize them, then interpolate from the first to the second. Repeat at intervals. Now you have a video. A full moving subject is about 500Mbps, although it depends a lot on the quality of the source images that you make the 3D splats from and how detailed the output image is. Search for “4D gaussian splats” to find references.

| cubefox 20 days ago | root | parent | next [–] That's just animation like an animated GIF: a series of static frames. What's more interesting is animation in the sense of deformation, as in skeletal/skinned meshes. These deformations require minimal data and can be generated dynamically.

| db48x 20 days ago | root | parent | next [–] I can’t think of any reason why it would be impossible to implement skeletal animation of gaussian splats. You still have to create the splats from images though. Just have your subject put their right arm in, then take your images and generate the second splat. Now you can interpolate between them to move the right arm. At least in that one axis. Repeat for other joints. Have them put their whole self in and turn them selves about, etc. How hard could it be? https://www.youtube.com/watch?v=aIqCSpuDwBE

| joshvm 20 days ago | parent | prev | next [–] That one has a strange rendering error for me, the trees and horizon are in front of the mill building and the exterior isn't properly rendered unless you are in orbit mode. But my mind was a little blown when i discovered that I could walk up the stairs. It needs shift to run!The scene desperately needs some clipping on the boundaries. If you use an app like Scaniverse, you can add a bounding box to cull far away points which are often poorly reconstructed.If you have a newer iPhone with a LIDAR scanner, highly recommended. You can make dolls-house renderings of your house or garden which is surprisingly useful for planning and measuring walls/features.

| Vinnl 21 days ago | prev | next [–] I read [1], but I still don't quite know what I'm looking at. My guess is a 3D model reconstructed from lots of detailed pictures?[1] https://en.wikipedia.org/wiki/Gaussian_splatting

| jaccola 21 days ago | parent | next [–] Lots of translucent blobs composited to produce the appearance of a strawberry.There is no mesh or model. The visual surface of the strawberry could be made up of blobs spaced far apart physically and not where the surface appears to be.This is why they are called radiance fields, they model the light not the geometry.Practically the blobs positions/rotations can be constrained to better physically match the geometry of a strawberry.

| KeplerBoy 21 days ago | root | parent | next [–] I'm not sure i agree. The blobs are exactly where the surface appear to be because they are constrained by multiple viewing angles.Otherwise the splat would fall apart as soon as the viewing angle is changed slightly (Which it absolutely does in many examples on supersplat, you cannot really create an out of distribution view with 3GS, it's not magic)

| jaccola 21 days ago | root | parent | next [–] Yes, my statement was loose. The blob doesn’t really have a position since it is theoretically an infinite distribution in 3 space.It has a mean, and that mean doesn’t have to lie on the surface, consider the case where the mean is deep inside the strawberry but its spike contributes to the surface appearance (e.g a seed could be represented this way, or it could be represented by a small well-oriented blob on the surface, the optimiser doesn’t care)

| marceldegraaf 21 days ago | parent | prev | next [–] This video explains how Gaussian splatting works: https://www.youtube.com/watch?v=X8yRlA7jqEQ

| ddon 20 days ago | root | parent | next [–] Thank you for the link, amazing video!

| stevepotter 21 days ago | parent | prev | next [–] Others have provided details about how it works. I suggest zooming way in on that image and you'll start 'breaking though' the surface and that'll help you get an idea of how it works. Important thing is there is no defined geometric surface ("mesh"). Also important to know is that it's very, very hard to get a good splat without taking a ton of photos at different angles. It's also really, really easy to create a crappy looking splat. But when it's done right, it's a marvel

| lubesGordi 20 days ago | root | parent | next [–] When you say its very very hard to create a good splat, what do you mean? And what is good? I would say that strawberry is very detailed and its a good splat. I also kind of like the way some of the 'rougher' splats look. I feel like they'd work well in a car racing simulator.

| ZeWaka 20 days ago | root | parent | prev | next [–] I don't know, there's plenty of models these days that generate good splats just from objects at home.I took maybe 10 pictures of a model I built and threw it at my 3060 during dinner and it came out quite nice.

| StevenNunez 21 days ago | parent | prev | next [–] https://youtube.com/watch?v=X8yRlA7jqEQ is how I learned about them. They're really cool!

| KerrickStaley 21 days ago | parent | prev | next [–] Here’s a good 2 minute explainer https://youtu.be/HVv_IQKlafQ

| Vinnl 20 days ago | root | parent | next [–] Oh thanks - I was waiting for a moment where I could turn up sound to watch the other video, but I didn't realise that that would set me back half an hour. This is the perfect amount of background for now!

| Tade0 21 days ago | prev | next [–] Beautiful.What I love about gaussian splats is the way they degrade - instead of a hard cutoff or LoD changing spheres into cubes etc., they get increasingly "dreamy" - the basic idea is still there, just less detailed.Take for example this scene:https://superspl.at/scene/e721ea7cIf you navigate closer to the trees, things around you become blurry - as if the very fabric of reality unraveled.

| squidsoup 20 days ago | parent | next [–] You might enjoy some of my art derived from gaussian splats in that case, I've been calling them gaussographs.https://bayardrandel.com/gaussographsMore recent work on my instagramhttps://www.instagram.com/bayardrandel/

| danybittel 20 days ago | root | parent | next [–] Love these!

| scrumper 21 days ago | parent | prev | next [–] I don't know anything about them but it's a cool effect. At least on this strawberry, you're not zooming in but rather traveling closer. I don't see the increasing (made up) detail you'd expect from a zoom, we sort of pop through the skin into an invented interior.

| danybittel 21 days ago | parent | prev | next [–] I like that they are sort of between a photo and a 3D model. Nothing quite like it.

| stevep98 20 days ago | parent | prev | next [–] They remind me a lot of the 'memories' scene in Minority Report:https://www.youtube.com/watch?v=arTIRgdEb1g

| acc_297 21 days ago | parent | prev | next [–] its funny that sky features like clouds and blue patches end up being fit very close to ground level because there isn't a difference in perspective to cue in the algorithm that the skybox should be tall, I wonder if there is any way to incorporate the fitting algorithm with simultaneous lidar data about true distances of things to allow scenes to be viewed from further up

| ACCount37 20 days ago | parent | prev | next [–] Yeah, it's an incredibly cool effect. Reality breaking down into fog and frosted glass and paint smudges and slivers of northern lights and all the dandelion fluff. Even navigation becomes harder and less predictable as coherence recedes.This feels so much closer to how minds must store and process spatial information than the usual 3D models do.

| amelius 20 days ago | parent | prev | next [–] That's what Google Street View should be like more.

| 0x1ceb00da 20 days ago | root | parent | next [–] Gaussian splats are huge. I don't think they'll scale to google maps level. It'll be too much data.

| fragmede 20 days ago | root | parent | next [–] Google's downloaded most of the Internet for decades by this point. I don't think "it'll be too much data" is in their vocabulary.

| xattt 21 days ago | parent | prev | next [–] Is there a specific name for this “dreaminess” effect?

| jl6 21 days ago | root | parent | next [–] Splattenuation

| sovok 21 days ago | prev | next [–] Also interesting: https://github.com/apple/ml-sharpApples model to generate Gaussian splats from a single image. Takes about 30 seconds on an M1 Pro.It falls apart once you move too much, but for a little side-wiggling or a second-eye view for VR, it's great. And looks a lot better than the old approach of depth map + vertex shaders that I use in https://github.com/combatwombat/tiefling. But ml-sharp has 2.6 GB weights, a bit too big to run in the browser.

| ben7799 20 days ago | parent | next [–] Is this thing the basis of what Apple is doing in the Photos app in the most recent OS revisions?It seems to work a lot quicker than 30s now on iDevices and Macs.

| RobotToaster 21 days ago | parent | prev | next [–] Any idea what kind of vram is needed to run this on Nvidia?

| kridsdale1 21 days ago | root | parent | next [–] It runs natively on the Photos app in Vision Pro, which shares 16GB of ram with GPU and CPU.

| ArekDymalski 21 days ago | prev | next [–] As I have learned about Gaussian Splatting just a few weeks ago, I have (perhaps funny/naive/stupid) question: is there any progress or at least theoretical chance to have dynamic lighting?

| hellohello2 20 days ago | parent | next [–] There are some works on doing this directly e.g. https://arxiv.org/abs/2601.23065 but getting accurate materials is a challenge for anything more than diffuse.AI-based relighting will no doubt start working soon.

| aruametello 20 days ago | parent | prev | next [–] out of the box, I imagine that surfaces can be lit, but probably not shadowed correctly. (structures aren’t solids, more like particles in 3d space)it could look like the real-time lighting of an old game engine on rather modern assets. (quake 2-3 era)or perhaps some "occlusion pre-pass" could be done to create a voxelized sparse volume from the splats that set a "voxel opacity value" for each to absorb light? (not far from how prebaked GI works nowadays)note: not an expert on rendering, just a nutjob that did stuff in opengl in the old days.

| hellohello2 20 days ago | root | parent | next [–] There can be some issues with shadowing yeah, especially if you render with splatting/rasterization, but its fine if you raytrace I think.

| chimpanzee2 21 days ago | prev | next [–] Just wow!As I scrolled through the website, I was even more impressed with this one though!https://superspl.at/scene/c67edb74

| MattCruikshank 21 days ago | parent | next [–] I just wanted to do a quick size comparison...If I'm reading Chrome right, that's 171 MB, for the website, and the data.If I'm doing the math right, that's 40 seconds worth of the bandwidth from Netflix, at its highest rate.

| ComputerGuru 20 days ago | parent | prev | next [–] This one keeps crashing the browser after it reaches 100%. Safari/iOS, iPhone 13. I was able to navigate and use a few of the other ones linked to from the comments, though. Curious.

| busymom0 20 days ago | root | parent | next [–] I have the same phone and it crashed for me too after reaching 100%

| mkmk 21 days ago | parent | prev | next [–] Beautiful and quite neat to 'walk' up into the ceiling and look down. Feels like you're either quasimodo or God, depending on how nuts you are.

| FigmentEngine 21 days ago | parent | prev | next [–] shame the bishop behind looks a bit flat though ;-)

| painted-now 20 days ago | prev | next [–] It definitely looks impressive.But something looks off: the red area around the "seeds" is pushed towards the center of the strawberry - or that at least the outer most layer is somewhat transparent and some deeper layers are visible.

| danybittel 20 days ago | parent | next [–] Those are artefacts. Splats are not perfect around reflections.

| Centigonal 21 days ago | prev | next [–] This is like a beautiful little miniature. It's cool to see gaussian splatting applied to a detailed small thing versus a big scene.I have a question about perhaps the most boring aspect of this strawberry: the license. you write, "You can download it under CC BY license, but attribution is appreciated rather than required." IANAL, but I'm pretty sure you can't license your work CC-BY and then waive the BY requirement in the description. Rather, you'd have to license it with something more permissive like CC0 and request attribution if you want attribution to be optional. Is that right?

| RobotToaster 21 days ago | parent | next [–] I'm pretty sure it's allowed, just as saying "do what you want with it" is an informal license, it's just a little pointless.

| danybittel 20 days ago | root | parent | next [–] That's what I thought too.. supersplat has no way to set it to CC0 otherwise.

| CobrastanJorji 20 days ago | parent | prev | next [–] It's their content. They can do anything they like.Sort of. There are countries like France where attribution rights are fundamentally inalienable, and the author can always demand attribution, even after forever waiving the right to attribution. But in the US, the party who benefits from a contractual provision can generally choose to ignore or forfeit that provision. Whether it's still called the "CC BY" after that is debatable, since the whole point is attribution, but licensing by the CC BY and immediately waiving that requirement seems legitimate to me.

| ImJasonH 21 days ago | prev | next [–] I'm really interested to see what folks can do with animated Gaussian splats: https://youtu.be/X8yRlA7jqEQ?si=dXeHa03jO7MTBNLAThe filesize of a 3d animated splat is seemingly very small, and the method enables ~arbitrary FPS. But it seems the setup required to record it is still huge and expensive, which limits its usefulness.Even with that there are some interesting use cases, eg. I'd love to be able to watch concerts this way, and freely move around the stage and crowd from any angle.

| ImaCake 16 days ago | parent | next [–] You can do it with a phone camera, ffmpeg, colmap, and opensplat on an m4 macbook air easy enough. I got a nice render of my logitech mouse from it.

| idoco 21 days ago | parent | prev | next [–] Great video. I was about to share it here myself.

| vipshek 20 days ago | prev | next [–] This took me down a rabbit hole that led to this company, doing Gaussian splat videos: https://www.4dv.ai/. Fascinating.

| evrimoztamur 21 days ago | prev | next [–] There is a faint sensation of translucency, I wonder if that's an artefact of the process, or if it's the actual optics of the surface layer if the strawberry...

| danybittel 21 days ago | parent | next [–] It's an artefact unfortunately. Gaussian splats have no concept of refraction and have a hard time dealing with reflection. Highlights, usually so so. Something I always wrangle.

| zokier 20 days ago | root | parent | next [–] I wonder if that is somehow related to how you seem to have very strong studio light for the subjects? Somehow the bright light penetrating deeper into the material or something like that

| danybittel 20 days ago | root | parent | next [–] The light doesn't need to be completely flat like what you'd do when scanning it more traditionally, for meshing. The problem is when the highlight is sharp and reflects it's surrounding. You could remove it, with cross polarization.. But then it wouldn't look realistic anymore.

| vanderZwan 21 days ago | parent | prev | next [–] Well, at certain angles you actually get very noticeable gaps in the strawberry that are visible when rotating it, but almost invisible when static. I think it's mostly due to that.

| vessenes 21 days ago | prev | next [–] Dany, this is so cool.I'm wondering if the splat community has decided this paper is valuable -- https://github.com/fraunhoferhhi/Self-Organizing-Gaussians -- looking at all the detail in the strawberry splat made me wonder how small one can get the download, and what the current state of the art is for compression.

| danybittel 21 days ago | parent | next [–] Thanks! We have two compressed formats, the sog by PlayCanvas and spz with sparkjs. Both now support LODs and compress really well.

| zokier 21 days ago | prev | next [–] My intuition is that in theory focus stacking should not be necessary as preprocessing step for 3dgs (or photogrammetry). Does anyone know if there is any recent developments in this regard?Focus stacking generally is not perfect process and can lead to artifacts/errors and I'd imagine those can then compound when stacked images are used for 3dgs. Also the image focus actually provides some depth data in itself that could be useful?

| danybittel 21 days ago | parent | next [–] This is an interesting question. There has been some attempt to model the camera better than just a pinhole camera, that could work. https://dof-gaussian.github.io/ https://github.com/leoShen917/DoF-GaussianMy take.. at a macro scale, the dof is usually so small, that it's hard to get a reliably track. So you'd need some sort of way to tell that these stacked photos belong into a series, and then you sort of are doing focus stacking :-) I do think the alignment algorithm could be improved. Maybe the approaches I linked could be used to make a much more robust focus stacking algorithm, that also corrects for 3D geometry. That would be really cool!

| KeplerBoy 21 days ago | parent | prev | next [–] If you don't focus stack and try to train on partially unfocused images, the optimizer will try to match the rendered view to be also partially unfocused.You would have to mask out the blurry areas for each image. I guess one could just implement a feature where the optimizer only optimizes gaussians within the sharp distances relative to the camera.

| zokier 21 days ago | root | parent | next [–] Other way of looking at the question is if you could make focus stacking better by using the full multi-view dataset? Afaik focus stacking essentially does depth estimation so it seems like multiple views would help with that.Another way would be some kind of 4d GS where one dimension is the focus distance. But I'd guess the renders would inherently have shallow depth then, which is less useful usually.

| zardo 20 days ago | root | parent | next [–]

Another way would be some kind of 4d GS where one dimension is the focus distance.That seems like the way to do it, someone has to be working on that.searching...https://dof-gaussian.github.io/

| josh-wrale 21 days ago | prev | next [–] Someone: Please combine microscopy with gaussian splatting.

| jcattle 21 days ago | parent | next [–] Don't know if this would be in your wheelhouse, but for very nice macro splats, check out the work by Dany Bittel: https://danybittel.ch/macro.htmlFor example this bumblebee: https://superspl.at/scene/cf6ac78eEdit: I completely missed that this was posted by him (:

| kridsdale1 21 days ago | root | parent | next [–] Incredible that specular highlight isotropy vectors are somehow encoded.

| Kalendermann 21 days ago | parent | prev | next [–] This was also my first thought when I zoomed in into the strawberry. I wonder if you can achieve a microscope like effect with a more suitable setup. E.g. better lighting, zoom, lens, etc.

| danybittel 21 days ago | root | parent | next [–] I have done 2x macro (an ant).. and want to try 5x.. but as you get closer, the depth of field becomes really shallow. You can do focus stacking but you risk that the individual areas in focus are less ideal aligned and the tracking can't make any sense out of the geometry anymore.

| dredmorbius 21 days ago | prev | next [–] For those unfamiliar with Gaussian Splatting: <https://en.wikipedia.org/wiki/Gaussian_splatting>.(I'm ... still not sure what I'm looking at on TFA, and whether or not my browser configuration fails to fully present the site as intended.... OK, if all you're seeing is a blurred image of a strawberry, yes, you'll want to enable a bunch of JS resources. I'm using uMatrix, several hosts must be enabled.)

| karmakaze 20 days ago | parent | next [–] I like to think of Gaussian Splatting as a stage full of improv actors who are iteratively/concurrently filling details in regions down to pixels until the full picture is painted.

| lucb1e 20 days ago | prev | next [–] If you just see a blurry image and nothing loads or happens, check the javascript console if it says "WebGL not supported"

| KeplerBoy 21 days ago | prev | next [–] Can you elaborate why you chose slang-splat over let's say Lichtfeld studio? How does it compare to the other splat-training tools?

| danybittel 21 days ago | parent | next [–] I usually use PostShot.. but the quality was not very good. I want to try LichtFeld but my Graphics Card has too little memory.. so I reached out on twitter, some people ran tests and Mykhailo got some better quality out of it so I took his training. You can d/l the COLMAP dataset for free and try yourself.

| MattCruikshank 21 days ago | prev | next [–] I know feelings about AI are mixed. But when AI can dream up gaussian splats in real time, from a prompt, and do refinement as you get closer to things... That's going to be pretty bonkers.

| perching_aix 21 days ago | parent | next [–] That's kinda what NERFs are (neural radience fields). They actually preceeded this Gaussian story, with Gaussians coming in and outperforming them. Maybe they'll merge later for something even better, I don't know enough about them.

| cubefox 21 days ago | root | parent | next [–] NERFs have significantly higher image quality than 3D Gaussian Splatting or more recent similar techniques, though they are much slower to render.

| thrownthatway 20 days ago | root | parent | next [–] This one month old video did a reasonable job of getting my entirely ignorant self relatively up to day on NERFs and Gaussian Splats:https://youtu.be/X8yRlA7jqEQ

| Lerc 21 days ago | root | parent | next [–] Yes they are image generators. You want image generator generators.A diffusion style process generating gausians instead of pixels. You could possibly do nerfs that way, but it would be effectively generating a trained network. If you managed to do that it would have broad application throughout the field of AI.

| dpoloncsak 20 days ago | root | parent | next [–] What would this look like in practice? A net that outputs weights for a new net to use?

| xigoi 20 days ago | root | parent | next [–] Couldn’t you “uncurry” such a process to have only a single network?

| dpoloncsak 20 days ago | root | parent | next [–] Probably? I'm no expert, just a SysAdmin trying to keep up really... but in my head it's would look like a form of MoE that would gen the 'Expert' model on demand instead of having a variety baked in.That's assuming you could even reasonably train a neural net to output viable weights, of course.

| basch 20 days ago | parent | prev | next [–] I could see a kind of fun game / design tool / worldbuilding where you get a blurry world and you describe what you are seeing, and it comes into focus. The game world, mechanics, aesthetic, and playstyle build as you form your view. A sort of fog of war meets rorschach game.

| Lerc 21 days ago | parent | prev | next [–] This will be the future of a class of 3d Game. the prompt may not be text however.An input of a kind of schematic representation of what the designer wants would be better. It may resemble a storyboard or a collection of organised notes that large projects tend to already use.Fully generative could probably do some cool things, but people will still want to bring their peronal vision to life.

| satvikpendem 20 days ago | root | parent | next [–] Curious, why wouldn't the future be a full world model like Google's Genie? It just renders every pixel so someone could still make their vision come to life via a prompt too.

| Lerc 20 days ago | root | parent | next [–] It could be done that way but you are spending parameters managing the fact that the output changes completely with a change in view position or orientation. A observer independent model only has to manage changes of things that are actually changing in the world.Since you can view Gaussian splats from any POV you end up generating an output that is closer to the representation of the world instead of a projection that a single observer sees.

| MattCruikshank 20 days ago | root | parent | prev | next [–] Yeah, when you describe that, I picture Wave Function Collapse to generate a map schematic... And then a text prompt, and some style photos the designers want it to match.

| corysama 20 days ago | parent | prev | next [–] We are currently at real-time video generation that can be converted to splats or meshes.https://research.nvidia.com/labs/sil/projects/lyra2/

| notdefio 21 days ago | parent | prev | next [–] This sounds like it could be a great concept for a future sequel to LSD: Dream Emulator

| yard2010 21 days ago | root | parent | next [–] If I'm not mistaken that is the inspiration for one of Alt-J albums

| sbarre 21 days ago | prev | next [–] Looking at all the outdoor scenes that you can walk around, I wonder how long until we start seeing this in places like Google Maps/Earth, as a replacement for the low-res 3D renderings we have now.I guess the number of samples required to generate a GS is the constraint now, but maybe that will get solved.

| jofzar 21 days ago | parent | next [–] Google already has some splats on google maps,https://youtu.be/gXug7Kb3p4I

| dudefeliciano 21 days ago | parent | prev | next [–] rendering them is also non trivial from what i understand, since the millions of indivudal point positions need to be recalculated all the time while moving

| kridsdale1 20 days ago | root | parent | next [–] Turns out, GPUs are amazing at this.

| wren6991 20 days ago | prev | next [–] Noting the permissive license, could we be witnessing the birth of a new Utah teapot or Sponza atrium?

| danybittel 20 days ago | parent | next [–] Oh, that would be amazing! The photos are also available and some people definitely take it for a test ride. However.. This dataset with the stacking is far from generic.

| weystrom 21 days ago | prev | next [–] I tried making one, but I couldn't make through the camera position tracking bit, software was super unintuitive. Very interested in gaming applications for this tech, but still waiting for it to be more approachable from a layman's point of view.

| ChadNauseam 20 days ago | parent | next [–] One thing you can do with this that works quite well is use it to "decrop" (widen the viewing angle) of a video. This is very useful for stabilization which usually involves cropping. Here's an example: https://x.com/i/status/2051504427287404568Once they get quicker to train, I expect this to be a popular use of them

| divan 21 days ago | prev | next [–] Does anyone know if it's already possible to build gaussian splat of the person that moves/rotates from the single camera? (I.e. to use sequence of frames to reconstruct occluded parts of the body for other frames)

| thrownthatway 20 days ago | parent | next [–] I watched this 1 month old video two days ago:https://youtu.be/X8yRlA7jqEQIt kinda splatted my mind.As I understand it, Gussian Splats aren’t a method of constructing missing data in the sense you’re asking here.But there are other, well established, methods of generating missing data in convincing manner, that are beyond my field of expertise or interest to be able to repeat here.With the added benefit that if I’m wrong, being wrong can be a great way to spur discussion 8)

| divan 19 days ago | root | parent | next [–] There is definitely some body of research around what I'm asking [1] [2]. Just curious if someone have a good grasp on the current state of it.[1] https://openaccess.thecvf.com/content/CVPR2025/papers/Wu_Sin...[2] https://arxiv.org/abs/2409.04196

| galsapir 21 days ago | prev | next [–] From the link: "Shot from 90 perspectives, 88 focus stacked images each. Nikon Z8, full frame, f/7.1, exposure 1/160, ISO 100, Laowa 180mm macro lens, with LED light and bluescreen." Insane!

| danybittel 21 days ago | parent | next [–] And it only takes 20 Minutes to shoot all 7920 photos, the Z8 is crazy fast.

| dudefeliciano 21 days ago | root | parent | next [–] i made some decent splats (admittedly much lower quality than this) by taking video with my iphone13 mini and then chopping it up into individual frames via ffmpeg

| MattCruikshank 21 days ago | parent | prev | next [–] Where's the Lytro camera when you need one?I was really pulling for OTOY to keep making light field capture and display technology...

| danybittel 20 days ago | root | parent | next [–] There is actually still a Lytro type camera for industrial application available: https://raytrix.de/ Too low res, too expensive for my use case unfortunately.

| svetlins 21 days ago | prev | next [–] Great work! There are more awesome splats on the author's profile page: https://superspl.at/user?id=danylyon

| carlos-menezes 21 days ago | prev | next [–] You might want to throw that one away :)

| danybittel 21 days ago | parent | next [–] It is in fact still on it's mount and slowly rotting / molding.. for a second capture :-)

| p0w3n3d 21 days ago | parent | prev | next [–] Yup. It's rotten on the other side. Or maybe lead poisoned

| gobdovan 21 days ago | root | parent | next [–] Sorry if I fell for Poe's law, but just for clarity, the strawberry's rotten underside is most likely missing splats in the rendering.

| p0w3n3d 21 days ago | root | parent | next [–] Of course it is. That's where the joke comes from...Edit. TIL Poe's law

| dudefeliciano 21 days ago | parent | prev | next [–] not sure if that's a joke but i think that's just the effect of the strawberry being placed on a glass/plastic surface to be filmed from underneath

| socalgal2 20 days ago | prev | next [–] 4meg: https://sketchfab.com/3d-models/strawberry-dd6a4248076145448...vs48megSplats make pretty pictures but they are 10x the data for pretty much anything I've seen.3gig for this one: https://superspl.at/scene/8429e5e2

| mgaunard 21 days ago | prev | next [–] What happened to the bottom of that poor strawberry?

| danybittel 21 days ago | parent | next [–] It was mounted at the bottom.. and I can't quite reach it with my camera. Might have to try some two pass way.

| CatMustard 21 days ago | root | parent | next [–] I wonder would a good, sharp needle and thread make for good mounting for a soft object like this? Thread the needle, pass it right through the strawberry and the secure the thread on something above and below. As long as the strawberry doesn't slide down the thread (hopefully a strawberry is light enough friction would hold it in place!)Anyway, very cool splat, fair play

| danybittel 21 days ago | root | parent | next [–] I glue mounted the strawberry on three nails and used pins to secure it. I have to think about your idea.. I don't think friction would be enough to hold it in place.. it would probably be hard to knot the top onto something too, as that's where the light is: https://i.imgur.com/vIjw6pc.jpegBut I'm always experimenting with the mounting, thanks for the inputs.

| 4gotunameagain 21 days ago | root | parent | next [–] Assuming that the person that did this has not tried that. If you look at the setup photos, the grape is resting on a couple of nails. This suggests that many different things have been tried.

| gobdovan 21 days ago | parent | prev | next [–] Gaussian splat casualty. The bottom looks like partially missing from the reconstruction.

| timonoko 21 days ago | root | parent | next [–] When you cut the splat in half, result is either fuzzy fog or sort-of fibrous crystals. As depicted here.

| voidUpdate 21 days ago | prev | next [–] Gaussian splats look really good from a distance, but as soon as you zoom in, they really fall off a cliff :/

| brazzy 21 days ago | prev | next [–] Lovely! How was the mechanical setup to ensure that all those shots are consistent, and how long did it take?

| danybittel 21 days ago | parent | next [–] I posted some pictures.. takes only 20 min!

| a1o 21 days ago | prev | next [–] Can you show the setup?(Can we do a Gaussian Splat of the setup of the photograph for the Gaussian Splat of the Strawberry?)

| danybittel 21 days ago | parent | next [–] I just posted some images.. I have actually done my studio, (quality is.. let's say painterly ;-): https://superspl.at/scene/0a3916cd

| burningion 21 days ago | root | parent | next [–] The splat of the studio has the perfect amount of detail. It looks like you're streaming from the camera direct to the computer usually? How do you check the progress / quality while capturing? Seeing the (great) results makes me more curious about the process of creating now.

| danybittel 21 days ago | root | parent | next [–] Thanks! I use the computer only to setup the shot, adjust lighting make test stacks of different angles. If everything is good, I disconnect and capture to the memory stick. During the shooting I only adjust the beginning or end of the rail a bit, so everything is in focus at some point. Triggering (manually) the rotary disk still happens from the computer.

| eckelhesten 20 days ago | prev | next [–] I’m curious to why not all modern PC/console game developers use this technology to create realistic graphics in their games?If my old phone can render it with fairly high frame rate, I’m sure a full game with realistic graphics would work well on a mid/high end PC.

| steve_adams_86 20 days ago | parent | next [–] I’m not sure if the same limitations apply today, but when I last looked into it:1. Lighting is baked in so they don’t fit well in dynamically lit environments2. Splats aren’t as suitable for bodies you’d animate, like meshes are. They also don’t work well for very thin or sharp surfaces in general3. Splats are pretty memory-hungry so large scenes would require better hardware than consoles can offerThese might not be as true today, and I can’t recall exactly when I read this. Probably 3 years ago or so. I recently read they’re making their way into games, so it’ll happen as the kinks are worked out.

| 0xWTF 21 days ago | prev | next [–] How did they decide what the inside of the strawberry looks like? Because that seems very incorrect.

| db48x 20 days ago | parent | next [–] The flesh of the strawberry is very slightly translucent. By taking images from many angles, you can derive some information about the interior. This is not a separate step, it is simply the optimizer finding splats that contribute the right amount of color and light at various viewing angles. Of course those splats aren’t really going to look right to anyone who has ever eaten a strawberry, because they are only derived from the input images and not your past memories of a real strawberry.You’ll also see the same type of problems in any incomplete part of any scene. Go poke around any of them and you’ll find places where there wasn’t enough information to make a satisfying reconstruction. For example, the back of the moon <https://superspl.at/scene/2ac8f423>, the fridge in the coffee shop <https://superspl.at/scene/6a0c3ccf>, underneath the footbridge in the forest <https://superspl.at/scene/23ebe85c> (or indeed anything in the distance), etc, etc.

| porphyra 20 days ago | prev | next [–] That new Laowa 180mm macro lens is amazing. So sharp, free of chromatic aberrations, compact, and I like the long working distance and reduced perspective distortion that the 180mm focal length offers.

| varispeed 20 days ago | prev | next [–] Thanks for the reminder how fucked up British government is. Can't run VPN here. (imgur is not available in the UK thanks to those authoritarian twats called Labour)

| danybittel 20 days ago | parent | next [–] I also have them on x: https://x.com/DanyBittel/status/2055624819941483005 I thought direct image links are more welcomed here.

| ziofill 20 days ago | parent | prev | next [–] What do you mean you can’t run a VPN?

| varispeed 20 days ago | root | parent | next [–] Can't install anything on this particular machine.

| MattCruikshank 21 days ago | prev | next [–] I want some math Phds to sit down with the Corridor Crew guys and figure out how to make Gaussian Splat reconstruction way better, the way they came up with CorridorKey.

| bestouff 21 days ago | prev | next [–] This doesn't work at all for me (Linux desktop, tried with Firefox and Chrome). I only see "fullscreen-extended blurry thumbnails" of the splats.

| probably_wrong 21 days ago | parent | next [–] Works for me with Firefox 140.10.2esr on Devuan 5.

| corford 21 days ago | parent | prev | next [–] Works for me on Debian 13, Firefox 140.10.2esr-1~deb13u and Strix Halo gfx

| slimbuck 21 days ago | parent | prev | next [–] If you can, please check any output/errors on the developer console?

| bestouff 19 days ago | root | parent | next [–] https://pastebin.com/gyzQDstwLast lines:

HTTPS-First Mode: Upgrading insecure speculative TCP connection “http://superspl.at/” to use “https”. HTTPS-First Mode: Upgrading insecure request “http://superspl.at/” to use “https”. Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at https://sentry.sc-prod.net/api/302/envelope/?sentry_version=7&sentry_key=d107d06d48c2e0f20554f721048e3faa&sentry_client=sentry.javascript.react-router%2F10.50.0. (Reason: CORS request did not succeed). Status code: (null). 2 can't access property "messageManager", target is null ExtensionParent.sys.mjs:75:42 verifyActorForContext resource://gre/modules/ExtensionParent.sys.mjs:75 recvAPICall resource://gre/modules/ExtensionParent.sys.mjs:1186 _recv resource://gre/modules/ConduitsChild.sys.mjs:90 receiveMessage resource://gre/modules/ConduitsParent.sys.mjs:474 Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at https://sentry.sc-prod.net/api/302/envelope/?sentry_version=7&sentry_key=d107d06d48c2e0f20554f721048e3faa&sentry_client=sentry.javascript.react-router%2F10.50.0. (Reason: CORS request did not succeed). Status code: (null). 2 Missing resource in locale fr: devtools/client/toolbox.ftl can't access property "messageManager", target is null 3 ExtensionParent.sys.mjs:75:42 Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at https://sentry.sc-prod.net/api/302/envelope/?sentry_version=7&sentry_key=d107d06d48c2e0f20554f721048e3faa&sentry_client=sentry.javascript.react-router%2F10.50.0. (Reason: CORS request did not succeed). Status code: (null). TypeError: Response constructor: Response body is given with a null body status. Utils.sys.mjs:279:17

| monkpit 20 days ago | prev | next [–] I’m impressed by Gaussian Splatting and I love these kind of demos, but I have a noob question - can they respond to lighting?

| dagmx 20 days ago | parent | next [–] Not traditional Gaussian splats since they have their lighting baked in but there are alternate forms that have the ability to do so but largely in academia or very specific use cases

| buibuibui 21 days ago | prev | next [–] How can I start creating Guassian Splat of my environment with my 360 camera? Is it possible to do that with local software?

| arnabdey0503 21 days ago | prev | next [–] Very nice. did you segment the images before?

| danybittel 21 days ago | parent | next [–] Yes it's shoot in front of a bluescreen.

| arnabdey0503 17 days ago | root | parent | next [–] Any suggestions to capture and reproduce very small details in the object? Something works well for you?

| duckerduck 21 days ago | prev | next [–] Makes me wonder if we'll ever see a video game where the world is created by set designers irl.

| lubesGordi 20 days ago | parent | next [–] Sim racing is at least kind of like that.

| stuxnet79 20 days ago | prev | next [–] Word of warning to mobile users, this website completely crashed my Firefox instance on Android.

| FrogHire 19 days ago | prev | next [–] This is so beautiful. Am I crazy for saying I kinda wanna cry seeing this strawberry?

| lightedman 21 days ago | prev | next [–] A Youtuber that records jookin (a mid-South form of dance) uses Gaussian splats for his videos to bring the dancers out into the forefront and hold center stage, it's a neat trick.https://www.youtube.com/watch?v=k0MGoFaIiWs - WARNING - heavily adult lyrics and a loud starting "MOTHERFU*AAAAAAS" right off the top.

| evan_ 20 days ago | parent | next [–] That doesn’t really look like Gaussian splats to me- but this video, Helicopters by A$AP Rocky, uses the technique well:https://youtu.be/g1-46Nu3HxQ?si=y_u257DzgOg2QV83

| hamburglar 20 days ago | parent | prev | next [–] What makes you say this is using Gaussian splats? It looks like simple motion-based cropping to me.

| lightedman 20 days ago | root | parent | next [–] Because I know the video producer and have talked about this in-depth with him.

| NoSalt 20 days ago | prev | next [–] Is it me, or does the backside of that berry not look too good?

| ted_dunning 20 days ago | parent | next [–] If you don't like the backside, check out the inside!

| bozdemir 21 days ago | prev | next [–] this is awesome, I wonder what's under there, looks black, maybe thats where they mounted and rotated the strawberry...

| danybittel 21 days ago | parent | next [–] Yes mounting.. and I can't quite reach all the way from below.

| account42 20 days ago | prev | next [–]

500> Oops!> navigator.sendBeacon is not a functionAnd it shouldn't be one.

| classified 21 days ago | prev | next [–] Impressive, but my poor GPU is melting :)

| BobbyTables2 20 days ago | prev | next [–] Looks like it’s already going bad…

| ramon156 21 days ago | prev | next [–] Imagine if we start designing GPUs around this technology as opposed to vectors. Imagine what voxel engines would look like. Would love a simulated experience or a small scale that theorizes about this.

| thatxliner 20 days ago | prev | next [–] it's weird at the bottom

| timonoko 21 days ago | prev | next [–] What? KIRI Engine makes splats. I always wondered what 3DGS might mean.Yes. I knoweth what "splats" are: They are splats of fuzzy blobs on the display surface.

| artursapek 21 days ago | prev | next [–] ew the bottom is moldy

| tantalor 21 days ago | prev | next [–] Really terrible performance in Chrome, I'm getting between 10-15fps.What's the matter?

| jrflo 21 days ago | parent | next [–] It appears to be rendering locally, my fans started spinning up when I was wandering through another image on the site.

| tantalor 21 days ago | root | parent | next [–] Where else would it render??

| jrflo 20 days ago | root | parent | next [–] I just meant that it's rendering the 3D view live in your browser, not streaming a video of the rendered output

| | 21 days ago | prev | next [–] [deleted]

Search: