Whether evaluation data can be accessed

[Captain6606]

First of all, thank you for your outstanding work!

I am a beginner who has just entered this field. I would like to know whether it is possible to obtain the input data (RGB and LiDAR) used for model evaluation when running local_evaluation.sh. If it is possible, please let me know how to obtain this input data. Thank you very much, and I look forward to your reply.

[Kait0]

The raw data can be accessed here via the input_data variable.
It is dynamically generated during evaluation since we are evaluating closed-loop.

[Captain6606]

First of all, thank you for your reply. I will try to obtain the data as per your description.

Additionally, I have a few more questions: Does the "raw data" here refer to the data used for model evaluation or the data used for model training? I need to obtain the data specifically for model evaluation, as I intend to make modifications to the data to re-evaluate the model.
Lastly, does "evaluating closed-loop" mean that the system's output is fed back into the input?
Thank you very much.

[Captain6606]

If I only need to evaluate the model, do I still have to download this 210GB dataset?

[Kait0]

Perhaps you can familiarize yourself a bit with the literature before diving in.
We offer a survey and lecture for that purpose.

There is no evaluation dataset, the model is evaluated in simulation.
If you only want to investigate evaluation, you do not need to download the training dataset.

[Captain6606]

I'm really sorry, but I've already read your paper. I know there is no dataset for evaluation, but I'd like to know if I can obtain the sensor data in real-time during the simulation evaluation (this data would be very useful for my follow-up research).

[Kait0]

yes you can, see my first answer.