Image Segmentation with PaliGemma 2 Mix and MLX

In this post, we are going to explore Google’s PaliGemma 2 mix vision-language model (VLM), and its capabilities to perform image segmentation. What’s interesting is that we are going to perform this task by only using Apple’s MLX framework, and MLX-VLM. This would eliminate the dependency of using JAX/Flax as in the original Google’s segmentation script, and would allow us to fully and seamlessly utilise Apple’s unified memory.

Lissajous Curves

Lissajous (/ˈlɪsəʒuː/) curves or also Lissajous figures or even Bowditch curves are the family of curves described by the following parametric equations

Dual Contouring

This post is going to cover the so called Dual Contouring of Hermite Data introduced in the following paper. Dual Contouring is a surface extraction technique that builds on ideas from methods like Marching Cubes but uses “dual” grid information to place vertices in cells based on Hermite data (i.e. both the intersection points of the isosurface with grid edges and the corresponding normals). The algorithm is particularly good at capturing sharp features and generating crack‐free meshes. In what follows, we are goig to walk through the main ideas and steps in detail.

Fourier Method for the 2D Wave Equation: Rectangular Membrane

In this post we are going to explore the Fourier method for solving the 2D wave equation. For the 2D wave equation we are going to show the application of the method to a rectangular membrane. We are also going to attempt to outline some of the physical interpretations of the rectangular membrane.

Fourier Method for the Wave Equation

In this post we are going to explore the Fourier method for solving the 1D and 2D wave equations. The method is more known under the name of the method of separation of variables. For the 1D wave equation we are going to show the application of the method to a fixed string, and for the 2D wave equation we are going to apply the method to a rectangular membrane and a circular membrane. We are also going to attempt to outline the physical interpretations of all scenarios.

Wave Equation

Partial differential equations...

links

social