We are running a survey to help us improve the experience for all of our members. If you see the survey appear, please take the time to tell us about your experience if you can.
Hi, I'm trying to measure the power of a deep learning model at Raspberry Pi, Jetson, etc ..
And I have just three questions.
1. The description page of v 6.x contains information about Python code profiling, but it was not on the description page of v 7.x.
Did the function get deleted after moving on to version 7?
2. Is code profiling function available even if I use NIDAQ equipment instead of Energy Probe?
3. The figure on the description page showed NI USB-621x as an example, is that the only line available? If so, which device is appropriate?(e.g. USB-6211)
(Arm Streamline User Guide Version 7.5)
Thanks a lot!
I am trying to load a deep learning model on Raspberry Pi, infer one data, and obtain records such as power in the meantime. The language used is Python, and I want to obtain measurement records only where the model runs(predicts) in the structure as shown below.
...
model = tf.keras.models.load_model('model')
y = model.predict(data_x) # Here is where I want to log
The size of the model can be very small, so the inference time may be about 1 ms. Then is it okay to use the python profiler function of 6.x version?
If not, how can I log that part?
Thanks
Streamline is a sample-based profiler, typically taking 1ms samples, so it won't work well with a single run of the network. You will need to run the model in a loop for 5-10 seconds to build up a statistically useful sample set.
I'd always start with the built-in profiler in Python to see how well that works docs.python.org/.../profile.html
Arm Streamline User Guide Version 7.5
On the page above, it is said that even smaller units than 1ms can be reported, is 1ms maximum when sampling power?
The sample rate in that dialog is for the on-device sampling. For power analysis the sample rate is defined by the probe hardware, and isn't configurable. For NI DAQ hardware using Caiman the sample rate is 10KHz.
Pete
Thank you!
1. Then is it right that the sample rate of arm probe is 1khz and the sample rate of NI DAQ is 10khz?
And according to streamline 7.0 documents(Arm Streamline Performance Analyzer User Guide Version 7.0), the maximum sampling rate in 7.0 version is 1khz, but if it does, does it get 1khz samples even if I use ni daq to sample 10khz?
2. According to this page(Arm Streamline Performance Analyzer User Guide Version 7.0), it says 'NI-DAQmx software installed on your host machine, so caiman can communicate with the NI DAQ device. This software package includes drivers for the NI DAQ device. You must use the NI-DAQmx Base software on Linux.'
Then do I have to install and use streamline and DAQmx Base in linux environment?
The default visualization will present 1ms data points, merging multiple samples. If you analyze in high resolution mode the higher detail power data will be preserved (but the normal data captured at 1ms samples will be interpolated).To use the NI DAQ with Streamline you will need to install the NI DAQ software to provide the device drivers for the hardware.