Python: Accessing and displaying raw images

[dm12506]

Good Afternoon,

At the moment I'm trying to get image stills (with the intention to use video later) from both of the cameras so that I can do some range and resolution testing.

I've had a read of this thread and tried to implement some of the code examples given:

    def on_frame(self, controller):
        frame = controller.frame()
        for i in range(2):
            leap_image = frame.images[i]
            imagedata = ctypes.cast(leap_image.data_pointer, ctypes.POINTER(leap_image.width*leap_image.height*ctypes.c_ubyte)).contents
            image = PIL.Image.frombuffer("L", (leap_image.width, leap_image.height), imagedata, "raw", "L", 0, 1)
            if i == 0:
                image.save("Left.png")
            elif i== 1:
                image.save("Right.png")

This doesn't output the left and right images, and I'm not sure where it is going wrong...

I would also like to use PIL or MatPlotLib to show one (or both) of the images. Though I think this should be very straightforward once I've got a usable image array.

Thanks,

Dave

[Joe_Ward]

This is how I converted the raw image to a PIL image using the new data_pointer property:

def image_to_pil(self, leap_image):
    address = int(leap_image.data_pointer)
    ctype_array_def = ctypes.c_ubyte * leap_image.width * leap_image.height
    # as ctypes array:
    as_ctype_array = ctype_array_def.from_address(address)
    # as numpy array:
    as_numpy_array = numpy.ctypeslib.as_array(as_ctype_array)
    buffer = numpy.reshape(as_numpy_array, (leap_image.height, leap_image.width))
    # to PIL Image:
    pil_image = Image.fromarray(buffer, "L")
    # change format for QT:
    pil_image = pil_image.convert("RGB")

    return pil_image

[dm12506]

Thank you for your very speedy reply!

That is giving me an error in the second line (address = int(leap_image.data_pointer))

TypeError: int() argument must be a string or number, not 'NoneType'

I'm putting the argument, leap_image, as one of the images from the image list. For example:

leap_image = frame.images[0]

Is that correct? Or have I accessed the frame in the wrong way?

Also for this situation is it better to use a listener or not?

[dm12506]

Testing the leap_image using:

if leap_image.is_valid

shows that frames.images[0] is not valid. What would be causing the leap to return invalid image data?

[Joe_Ward]

The images will be invalid if "Allow Images" is turned off in the control panel, if you haven't set the images policy using the Controller.set_policy() function, or if the Frame object itself is invalid.

[dm12506]

Ah, I hadn't set the images policy in the code. Thank you for your help Joe.

[201821030184]

That is giving me an error in the second line(address = int(leap_image.data_pointer))
TypeError: int() argument must be a string or number, not 'NoneType'

my leap_image = frame.images[0]
leap_image.is_valid return True always

what's the wrong with this? thanks in advance