It is a good question. The question of whether a certain power of the solar panel is sufficient cannot be answered in a general way.
It depends on many factors and also on whether solar is the only source to recharge the battery or if, for example, you drive daily and it is also charged by the alternator. Then the answer depends on how high quality a solar panel is. A 100 watt panel does not deliver 100 watts, but a high quality one probably delivers more like 80 or 85 watts (this power rating is sometimes independently certified, depends on the product). Then the location and the season is quite crucial. The number of hours of sunshine and the angle of irradiation changes so massively.
Thus, we have to make many assumptions and calculating the actual sizing is not easy either. However, you made a good start by asking yourself what consumers you actually have. I would do the following:
Make a list and write down how many watts these consumers consume and how long you use them per day. This way you can determine the required watt hours. This is the energy that you need to draw from and return to your battery during one (average) day. An example:
Fridge 30 watts for 10 hours a day = 300 watt hours
Lights 5 watts (LED) for 3 hours a day = 15 watt hours
Charger Tablet/ Phone 15 watts for 2 hours a day = 30watt hours
In total 345 watt hours
Now you need to know how long on average the sun shines at your travel location. And you can calculate how big the module should be in average. Let me make an example: In Germany, the sun shines on average about 4 to 5 hours a day and in summer much more. After deductions for wiring losses and efficiency of the panel and general safety buffer, you now see that a 100 watt solar module could be sufficient in above mentioned example. In a month like November or December where we have here sometimes only 2h sunshine per day it could be not sufficient. But on the other hand it is cold then and we do not need a fridge or it runs not so often so needs less energy.
Let's look at the practical application. For me, a 100 watt module has proven itself in practice. I run a 100 watt solar module with a MPPT regulator into a 95Ah AGM aux battery since over 10 years in my rig. I run a compressor fridge, some light and charge laptop, tablet, etc. on the aux battery.
Maybe this train of thought will help you a little chosing your setup.