Hi Rybitski,
Welcome to our forum. ;D
Does your transformer have a 12VDC output or an AC output? Without a rectifier, AC destroys LEDs.
Your problem is that the LEDs in your circuit operate at more than their rated max of 30mA.
Your "transformer", which is probably an AC to DC adapter is rated to have a 12V output when it has a 300mA load. It is probably cheap and not regulated so with less load current its output voltage is higher, maybe 15V or more. If its output voltage is 15V and the voltage of your LEDs are 3.3V then with the pot set for max brightness, 11.7V will be across the 100 ohm current limiting resistor and the current calculates to be 117mA. The 100 ohm resistor will be cooking at 1.4W and if it is too small maybe is burned and a lower value, causing more current.
If the LEDs are exactly the same, each will share the total current and operate at 117mA/4= 29.3mA. Leds are not exactly the same, Each LED has a slightly different voltage. Therefore the LED with the highest voltage will operate at a higher current than the others in parallel and since the average max current in your circuit is so close to the max current rating of the LEDs then it will burn out. The other LEDs in parallel will try to share the current but now there are only 3 LEDs so each operates at 117mA/3= 39mA and will quickly burn out one after the other.
LEDs should never be operated in parallel at high current. You have about 15V so 3 LEDs could be wired in series, and in series with a current limiting resistor and a pot.The values of the resistor and pot will need to be re-calculated. In series, the LEDs have exactly the same current which is much lower than if they were in parallel. The lower current might cause the adapter's output voltage to be high enough for 4 LEDs in series. If the voltage isn't high enough for 4 LEDs then two strings of 2 LEDs in series with a current limiting resistor can be in parallel and in series with a pot.