network rendering central control program (C#)

dougal2 · Post by **dougal2** » Fri Apr 18, 2008 3:58 am

also bear in mind that .igi files (same/similar data as indigo slaves transmit across the network) don't actually compress very well:

Code: Select all

17,285,040 im1188991340.igi
16,416,112 im1188991340.igi.bz2
16,047,131 im1188991340.igi.zip
16,047,002 im1188991340.igi.gz

Zom-B · Post by **Zom-B** » Fri Apr 18, 2008 5:04 am

Using 7z compression, you can pull it down to 76% of original File size...

zsouthboy · Post by **zsouthboy** » Fri Apr 18, 2008 5:21 am

For a network render, set your upload frame time to 10 minutes or more, to reduce network load. Your end result won't matter.

7z does a better job (not great, but better) at compressing igi files, btw.

EDIT: ZomB beat me to it.

dougal2 · Post by **dougal2** » Fri Apr 18, 2008 5:23 am

nope.

15,800,239 im1188991340.7z

yeah ok, it's smaller than the others but it's still 91%.

alex22 · Post by **alex22** » Fri Apr 18, 2008 6:18 am

It would be nice to have a compression like png. For example you could just save the difference of a pixel to the pixel left of it. Then you compress everything with zip. Especially the exponents of the colors (they are float, aren't they?) shouldn't change that much over the picture.

dougal2 · Post by **dougal2** » Fri Apr 18, 2008 6:20 am

alex22
don't change much? are you kidding? especially the first few frames to upload will be very noisy indeed and that's what kills the compression ratio.

Sukrim · Post by **Sukrim** » Fri Apr 18, 2008 6:57 am

Does the Slave have to give updates that often or wouldn't a single update after let's say an hour or xxxxx spp or so be enough?

dougal2 · Post by **dougal2** » Fri Apr 18, 2008 7:00 am

you can set frame_upload_period to whatever you like.

Sukrim · Post by **Sukrim** » Fri Apr 18, 2008 7:11 am

Well then it wouldn't even have to upload at all?

As far as I understand it, all network rendering does is render the same picture as the master with a different seed and then send the file sometimes to the master that then tries to stitch the igi-files together, right?

Then it would also be possible to render a file until xxxxx spp, send the resulting picture back to a master and then recombine the image?

If yes, this would be ideal for a possible BOINC project, since you can already pack a scene into an archive and distribute + render that over the net... if you could then collect the results and recombine them to the final picture you "only" have to build up a BOINC project!

nikolatesla20 · Post by **nikolatesla20** » Fri Apr 18, 2008 7:25 am

That may be true, but one of the reasons I like to have network rendering is also to increase the speed of the rendering so I can make adjustments more quickly. So I don't want to wait 1 hour between updates if I'm trying to tweak the scene to look like I want

Hence network rendering speeds up the tweaking a lot imho.

Although, at final render time, you could then set your upload rate to a slower value.

-niko

Sukrim · Post by **Sukrim** » Fri Apr 18, 2008 7:42 am

Yeah, internet rendering would be only useful for final renders and animations, since they might take 1 or 2 days until the results are submitted back from the clients.

Network rendering for previews though is mostly just for small resolutions so compression doesn't matter that much I guess...

Zom-B · Post by **Zom-B** » Fri Apr 18, 2008 8:16 am

dougal2 wrote:nope.

15,800,239 im1188991340.7z

yeah ok, it's smaller than the others but it's still 91%.

I tested now on 3 different igi files from 14 to 102 MB, and I have to confirm my ~76%!

I have no idea if the content of an igi is related to compression size,
here are my 7zip settings using version 4.57 x64:

PureSpider · Post by **PureSpider** » Fri Apr 18, 2008 8:34 am

Stay on topic please

Sukrim · Post by **Sukrim** » Fri Apr 18, 2008 9:04 am

This is ontopic, since the application maybe should include compression of the "update" pictures of Indigo slaves or not, depending on how good they can be compressed.

PureSpider · Post by **PureSpider** » Mon Apr 21, 2008 6:19 am

Any news on this?

network rendering central control program (C#)

Who is online