How does a semilive surgery take place?
Vecteur M, Olivier Madar. olivier(dot)madar(at)vecteurm(dotcom)
We have to record 5 to 6 separate video streams in full size, and perfectly in sync, to be able, to recreate the real live feeling for the surgeons. Urologists like to be immersed in a mosaic of 4 images, with many relevant and simultaneous visual information. Thus, they perceive all the details and feel the intervention as if they were in the operating room.
All the records must be the same standard and frequencies : 1080i50 Hz or 1080psf 25 frames/sec (better).
All the records must be EXACTLY in sync with the same timecode. Ensuring the synchronization of all recordings is the exclusive responsibility of the film crew, because resynchronizing shots AFTER filming is often impossible and consumes considerable time. A bad synchronization destroys all the immersive effect sought by this method of shooting
The axis of view are as follows:
1) Wide shot of operating room with overview of the room
2) Endoscopic plan
3) Surgeon's hands view from above
4) Right or left lateral plane, centered on the hands
5) Head plan of surgeon with endoscope in hands
6) Complementary plans (dashboard of a laser, echograph, xray, macro plane on the table of a calculation, …)
Editing purpose is to cut out unwanted times if there are any, choose important shots among the 6 and layout accordingly. For example, if the endoscope is the priority axis of view, a layout full size endoscope + 3 small plans will be chosen. If 2 or more axis of view are of equal importance, a mosaic of 4 equal part will be chosen.
On this picture, you can see the mobile production unit on a little trolley that we found in the surgical room.4 recorders are visible, but there are 2 more to have 6 axies of view wich is the good number for endourology.
On this picture, you can see the 3x panasonic robotics camera + the mobile camera with HF antennas, and the dolly with 3×3 liters of serum for counterweight that we found also in the surgical room. What you do not see is the scaler that convert the endoscopic image from the endoscope, the scaler wich convert the xray image and the 3rd scaler “just in case” of something we did not program or know.
Here is an example of a full axis of view mosaïc we recorded with Dr Lerich.
And here is the edited final version of the Dr Lerich video as shown at WCE 2018. The sound have been removed as Karin was doing the audio “live”. However, I always record audio of the surgeon because it helps me a lot during the editing when back at the office.
Here is the schedule we use for a semilive recording :
1) Preparation time : travel, contact, nearest hotel from the hospital
2) Preparation the day before the surgery : install all the camera and scaler and recorders all in sync
3) D Day, record and back to office
4) Create the full axis of view mosaic (as dr Lerich example) and send this mosaic to the surgeon. At least 2 days
5) Editing time : in consultation with the surgeon, choose what to keep, what to remove and which axis of view is important. At least 7 days. We are working on a portable (by plane) configuration to play live streams and make live layout choices during the congress. This solution would save editing time and make the experience even more live for the audience. I do not know yet if this option will be available for WCE2019, I still need 3 or 4 days to validate the tests.
6) Master editing in h264 10Mbits/sec, when all is ok and ready to use for the congress. At least 1 day.
If you want to do a semilive recording in a different way
I don't know how many cameras and recorder your video team can have, use as many as you can, and try to think ahead where the visual information will be. Don't try to record only when there is something interesting happening, record everything and all in sync. Only 1 start and only 1 stop is the best way to have of axis of view in sync.
If you have less than 4 axis of view, it won't be a “semilive” recording, just a “normal” recording, because you won't be able to use a mosaic view of 4.
If you can't have the same format and framerate for all cameras and sources, you will need to comply during the editing time, and you won't be sure to stay in sync. When your team will start the record, they should NOT stop until the surgery is finished.
