Logged in as: Guest
Login
: 2026-02_kek:72
🔗 http://www.cns.s.u-tokyo.ac.jp/~lim/elog/doku.php?id=2026-02_kek:72
Subject: Re: Data type change: int8 -> float16Type: Error/FaultCategory: GeneralTags: ReplyTo: 62
Thread
     #72 — Re: Data type change: int8 -> float16 current

Re: Data type change: int8 -> float16

The TeleDyne LeCroy Control Class (https://github.com/BongHwi/TeleDyneLeCroyControl) was handling the scope data with 8bit type.

This issue has been solved by adding this line: self.write("CFMT DEF9,WORD,BIN") for configuring the scope.

The attached plot shows the two different waveform shapes (RED: new 12bit, BLUE: old, 8bit)


Details:

The issue has been found by Satoshi, observing the raw wave form with unnatural (descreted signal shape)

→ Disussed for the proper shape of the signal → The current oscilloscope was 12bit type (HD), so it should handle 12bit data (4096 points) → The current scope class was based on the 8bit data (int8) → Forcing 16 bit data type (WORD instead of BYTE) soved the issue. → Git PR https://github.com/BongHwi/TeleDyneLeCroyControl/commit/ddce5bc11b95bd501fe7f39d3b570cd8c1377d9a