Task 1724891221

Stderr output

<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
putenv 'LAL_DEBUG_LEVEL=3'
2025-02-05 08:22:07.8394 (116745) [normal]: This program is published under the GNU General Public License, version 2
2025-02-05 08:22:07.8395 (116745) [normal]: For details see http://einstein.phys.uwm.edu/license.php
2025-02-05 08:22:07.8395 (116745) [normal]: This Einstein@home App was built at: Mar  7 2024 14:38:26

2025-02-05 08:22:07.8395 (116745) [normal]: Start of BOINC application '../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.16_x86_64-pc-linux-gnu__GW-cuda-3'.
2025-02-05 08:22:07.8402 (116745) [debug]: Flags: LAL_DEBUG, OPTIMIZE, HS_OPTIMIZATION, GC_SSE2_OPT, CUDA, X64, SSE, SSE2, GNUC X86 GNUX86
2025-02-05 08:22:07.8402 (116745) [debug]: glibc version/release: 2.36/stable
2025-02-05 08:22:07.840297 - mytime()
2025-02-05 08:22:07.8404 (116745) [debug]: Set up communication with graphics process.
2025-02-05 08:22:07.8514 (116745) [normal]: Parsed user input successfully
Code-version: %% LAL: 7.1.4.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALPulsar: 3.1.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALApps: 7.3.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)

2025-02-05 08:22:07.8514 (116745) [normal]: Initialise compartments with freqWidth = 0.05 and candidates per compartment = 10000.
2025-02-05 08:22:07.8516 (116745) [debug]: Opening temp output file '../../projects/einstein.phys.uwm.edu/h1_0180.80_O3aLC01Cl1In0__O3ASBu_181.00Hz_14994_0_0.tmp' for writing ...
2025-02-05 08:22:08.0851 (116745) [normal]: Reading input data ... 
2025-02-05 08:22:08.0851 (116745) [normal]: Loading SFTs matching '../../projects/einstein.phys.uwm.edu/h1_0180.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0180.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0181.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0181.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0181.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0181.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0181.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0181.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0181.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0181.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0181.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0181.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0182.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0182.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0182.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0182.20_O3aLC01Cl1In0' into catalog ...2025-02-05 08:22:08.3037 (116745) [normal]: done.
2025-02-05 08:22:08.3037 (116745) [normal]: Validating SFTs (detectors: H1, L1, ) ... success.
2025-02-05 08:22:10.8347 (116745) [normal]: Search FstatMethod used: 'ResampGPU'
2025-02-05 08:22:10.8347 (116745) [normal]: Recalc FstatMethod used: 'DemodGPU'
2025-02-05 08:22:10.8347 (116745) [normal]: GPU Device used for Search/Recalc and/or semi coherent step: 'NVIDIA GeForce GTX 980'
2025-02-05 08:22:10.8347 (116745) [normal]: GPU Backend used for Search/Recalc and/or semi coherent step: 'CUDA'
2025-02-05 08:22:10.8347 (116745) [normal]: GPU version is used for the semi-coherent step!
2025-02-05 08:22:25.8383 (116745) [normal]: Number of segments: 18, total number of SFTs in segments: 5748
2025-02-05 08:22:25.8423 (116745) [normal]: Finished reading input data.
2025-02-05 08:22:25.8424 (116745) [normal]: GPS reference time = 1246070525.0000 ,  GPS data mid time = 1246070525.0000
2025-02-05 08:22:25.8424 (116745) [normal]: dFreqStack = 1.000000e-06, df1dot = 7.500000e-11, df2dot = 0.000000e+00, df3dot = 0.000000e+00
2025-02-05 08:22:25.8424 (116745) [normal]: Setup, N = 18, T = 878400 s, Tobs = 15809012 s, gammaRefine = 250, gamma2Refine = 1098, gamma3Refine = 1

DEPRECATION WARNING: program has invoked obsolete function InitDopplerSkyScan(). Please see XLALInitDopplerSkyScan() for information about a replacement.
2025-02-05 08:22:37.9233 (116745) [normal]: INFO: No checkpoint checkpoint.cpt found - starting from scratch
2025-02-05 08:22:37.9690 (116745) [normal]: Cpt:0,  total:9000,  sky:1/225,  f1dot:1/40

0.2025-02-05 08:22:37.9695 (116745) [normal]: CG:18010710 FG:1000000  f1dotmin_fg:-2.73735059761e-09 df1dot_fg:2.988047808765e-13 f2dotmin_fg:0 df2dot_fg:0 f3dotmin_fg:0 df3dot_fg:1
.......................................
1...........c
.............................
2........................................
3.......................................c
.
4........................................
5........................................
6...........................c
.............
7........................................
8........................................
9.................c
.......................
10........................................
11........................................
12......c
..................................
13........................................
14....................................c
....
15........................................
16........................................
17...........................c
.............
18........................................
19........................................
20.................c
.......................
21........................................
22........................................
23........c
................................
24........................................
25........................................c

26........................................
27........................................
28................................c
........
29........................................
30........................................
31.......................c
.................
32........................................
33........................................
34................c
........................
35........................................
36........................................
37.........c
...............................
38........................................
39........................................
40...c
.....................................
41........................................
42....................................c
....
43........................................
44........................................
45.............................c
...........
46........................................
47........................................
48.......................c
.................
49........................................
50........................................
51................c
........................
52........................................
53........................................
54..........c
..............................
55........................................
56........................................
57....c
....................................
58........................................
59......................................c
..
60........................................
61........................................
62.................................c
.......
63........................................
64........................................
65...........................c
.............
66........................................
67........................................
68.....................c
...................
69........................................
70........................................
71...............c
.........................
72........................................
73........................................
74........c
................................
75........................................
76........................................
77.c
.......................................
78........................................
79...................................c
.....
80........................................
81........................................
82..............................c
..........
83........................................
84........................................
85........................c
................
86........................................
87........................................
88..................c
......................
89........................................
90........................................
91.............c
...........................
92........................................
93........................................
94.......c
.................................
95........................................
96........................................
97.c
.......................................
98........................................
99....................................c
....
100........................................
101........................................
102...............................c
.........
103........................................
104........................................
105.........................c
...............
106........................................
107........................................
108...................c
.....................
109........................................
110........................................
111.............c
...........................
112........................................
113........................................
114........c
................................
115........................................
116........................................
117..c
......................................
118........................................
119.....................................c
...
120........................................
121........................................
122................................c
........
123........................................
124........................................
125...........................c
.............
126........................................
127........................................
128......................c
..................
129........................................
130........................................
131...............c
.........................
132........................................
133........................................
134.........c
...............................
135........................................
136........................................
137...c
.....................................
138........................................
139.....................................c
...
140........................................
141........................................
142...........................c
.............
143........................................
144........................................
145......................c
..................
146........................................
147........................................
148................c
........................
149........................................
150........................................
151...........c
.............................
152........................................
153........................................
154.......c
.................................
155........................................
156........................................
157.c
.......................................
158........................................
159...........................
2025-02-05 09:19:21.582381
-- signal handler called: signal 15
XLAL Error - UpdateSemiCohToplistsOptimTriple_GPU (/home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalapps/src/pulsar/GCT/HierarchSearchGCT.c:4392): GPU is not initialized!
XLAL Error - UpdateSemiCohToplistsOptimTriple_GPU (/home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalapps/src/pulsar/GCT/HierarchSearchGCT.c:4392): Generic failure
XLAL Error - MAIN (/home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalapps/src/pulsar/GCT/HierarchSearchGCT.c:2326): Check failed: UpdateSemiCohToplistsOptimTriple_GPU ( compartment, compartment2, compartment3, &finegrid, f1dot_fg, f2dot_fg, f3dot_fg, usefulParams.NSegmentsInvX, XLALUserVarWasSet(&uvar->f2dot), XLALUserVarWasSet(&uvar->f3dot), uvar->computeBSGL, uvar->getMaxFperSeg, uvar->writeLeanerOutput ) == XLAL_SUCCESS
XLAL Error - MAIN (/home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalapps/src/pulsar/GCT/HierarchSearchGCT.c:2326): Internal function call failed: Generic failure
2025-02-05 09:19:21.5825 (116745) [CRITICAL]: ERROR: MAIN() returned with error '1'
Code-version: %% LAL: 7.1.4.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALPulsar: 3.1.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALApps: 7.3.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)

FPU status flags: 
2025-02-05 09:19:21.5830 (116745) [debug]: worker done. return(1) to caller
2025-02-05 09:19:21.5830 (116745) [normal]: done. calling boinc_finish(1).
09:19:21 (116745): called boinc_finish
XLALCUDARelease: Total malloc from <TYPE>VectorGPU is greater than 0: 2076842109XLALCUDARelease: Total malloc from COMPLEX8FFTPlanGPU is greater than 0: 671088648 stack frames obtained for this thread:
Use gdb command: 'info line *0xADDRESS' to print corresponding line numbers.
../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.16_x86_64-pc-linux-gnu__GW-cuda-3[0x4301f7]
/lib/x86_64-linux-gnu/libc.so.6(+0x3c050)[0x7f3fc433b050]
/lib/x86_64-linux-gnu/libc.so.6(poll+0x4f)[0x7f3fc43fb1df]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x2baa9f)[0x7f3fc28baa9f]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x37d82f)[0x7f3fc297d82f]
/lib/x86_64-linux-gnu/libcuda.so.1(+0x2b59cf)[0x7f3fc28b59cf]
/lib/x86_64-linux-gnu/libc.so.6(+0x891c4)[0x7f3fc43881c4]
/lib/x86_64-linux-gnu/libc.so.6(+0x10985c)[0x7f3fc440885c]

End of stacktrace
Stack trace of LAL functions in worker thread:
InitDopplerSkyScan at /home/boinc/lalsuite/EinsteinAtHome/source/lalsuite/lalpulsar/lib/DopplerScan.c:291
At lowest level status code = 0: NO LAL ERROR REGISTERED
putenv 'LAL_DEBUG_LEVEL=3'
2025-02-05 13:00:52.8345 (1196) [normal]: This program is published under the GNU General Public License, version 2
2025-02-05 13:00:52.8345 (1196) [normal]: For details see http://einstein.phys.uwm.edu/license.php
2025-02-05 13:00:52.8345 (1196) [normal]: This Einstein@home App was built at: Mar  7 2024 14:38:26

2025-02-05 13:00:52.8345 (1196) [normal]: Start of BOINC application '../../projects/einstein.phys.uwm.edu/einstein_O3AS_1.16_x86_64-pc-linux-gnu__GW-cuda-3'.
2025-02-05 13:00:52.8383 (1196) [debug]: Flags: LAL_DEBUG, OPTIMIZE, HS_OPTIMIZATION, GC_SSE2_OPT, CUDA, X64, SSE, SSE2, GNUC X86 GNUX86
2025-02-05 13:00:52.8384 (1196) [debug]: glibc version/release: 2.36/stable
2025-02-05 13:00:52.838410 - mytime()
2025-02-05 13:00:52.8386 (1196) [debug]: Set up communication with graphics process.
2025-02-05 13:00:52.8927 (1196) [normal]: Parsed user input successfully
Code-version: %% LAL: 7.1.4.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALPulsar: 3.1.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALApps: 7.3.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)

2025-02-05 13:00:52.8928 (1196) [normal]: Initialise compartments with freqWidth = 0.05 and candidates per compartment = 10000.
2025-02-05 13:00:52.8930 (1196) [debug]: Opening temp output file '../../projects/einstein.phys.uwm.edu/h1_0180.80_O3aLC01Cl1In0__O3ASBu_181.00Hz_14994_0_0.tmp' for writing ...
2025-02-05 13:00:53.1324 (1196) [normal]: Reading input data ... 
2025-02-05 13:00:53.1324 (1196) [normal]: Loading SFTs matching '../../projects/einstein.phys.uwm.edu/h1_0180.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0180.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0181.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0181.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0181.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0181.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0181.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0181.40_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0181.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0181.60_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0181.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0181.80_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0182.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0182.00_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/h1_0182.20_O3aLC01Cl1In0;../../projects/einstein.phys.uwm.edu/l1_0182.20_O3aLC01Cl1In0' into catalog ...2025-02-05 13:00:53.3507 (1196) [normal]: done.
2025-02-05 13:00:53.3507 (1196) [normal]: Validating SFTs (detectors: H1, L1, ) ... success.
2025-02-05 13:00:55.5820 (1196) [normal]: Search FstatMethod used: 'ResampGPU'
2025-02-05 13:00:55.5821 (1196) [normal]: Recalc FstatMethod used: 'DemodGPU'
2025-02-05 13:00:55.5821 (1196) [normal]: GPU Device used for Search/Recalc and/or semi coherent step: 'NVIDIA GeForce GTX 1660 SUPER'
2025-02-05 13:00:55.5821 (1196) [normal]: GPU Backend used for Search/Recalc and/or semi coherent step: 'CUDA'
2025-02-05 13:00:55.5821 (1196) [normal]: GPU version is used for the semi-coherent step!
2025-02-05 13:01:09.8964 (1196) [normal]: Number of segments: 18, total number of SFTs in segments: 5748
2025-02-05 13:01:09.8996 (1196) [normal]: Finished reading input data.
2025-02-05 13:01:09.8997 (1196) [normal]: GPS reference time = 1246070525.0000 ,  GPS data mid time = 1246070525.0000
2025-02-05 13:01:09.8997 (1196) [normal]: dFreqStack = 1.000000e-06, df1dot = 7.500000e-11, df2dot = 0.000000e+00, df3dot = 0.000000e+00
2025-02-05 13:01:09.8997 (1196) [normal]: Setup, N = 18, T = 878400 s, Tobs = 15809012 s, gammaRefine = 250, gamma2Refine = 1098, gamma3Refine = 1

DEPRECATION WARNING: program has invoked obsolete function InitDopplerSkyScan(). Please see XLALInitDopplerSkyScan() for information about a replacement.
2025-02-05 13:01:22.5957 (1196) [normal]: Successfully read checkpoint:6281
2025-02-05 13:01:22.6664 (1196) [normal]: Cpt:6281,  total:9000,  sky:158/225,  f1dot:2/40

157.2025-02-05 13:01:22.6671 (1196) [normal]: CG:18010710 FG:1000000  f1dotmin_fg:-2.66235059761e-09 df1dot_fg:2.988047808765e-13 f2dotmin_fg:0 df2dot_fg:0 f3dotmin_fg:0 df3dot_fg:1
......................................
158........................................
159............c
............................
160........................................
161........................................
162........................................
163............................c
............
164........................................
165........................................
166........................................
167........................................
168....c
....................................
169........................................
170........................................
171........................................
172..................c
......................
173........................................
174........................................
175........................................
176.................................c
.......
177........................................
178........................................
179........................................
180........................................
181........c
................................
182........................................
183........................................
184........................................
185.........................c
...............
186........................................
187........................................
188........................................
189.......................................c
.
190........................................
191........................................
192........................................
193........................................
194............c
............................
195........................................
196........................................
197........................................
198.........................c
...............
199........................................
200........................................
201........................................
202......................................c
..
203........................................
204........................................
205........................................
206........................................
207...........c
.............................
208........................................
209........................................
210........................................
211........................c
................
212........................................
213........................................
214........................................
215.....................................c
...
216........................................
217........................................
218........................................
219........................................
220..........c
..............................
221........................................
222........................................
223........................................
224........................c
................
2025-02-05 13:17:00.5137 (1196) [normal]: Finished main analysis.
2025-02-05 13:17:00.5138 (1196) [normal]: Recalculating statistics for the final toplist(s)...
2025-02-05 13:17:04.3881 (1196) [normal]: Recalculation step: 20000/200000
2025-02-05 13:17:08.1771 (1196) [normal]: Recalculation step: 40000/200000
2025-02-05 13:17:11.9798 (1196) [normal]: Recalculation step: 60000/200000
2025-02-05 13:17:15.7888 (1196) [normal]: Recalculation step: 80000/200000
2025-02-05 13:17:19.5981 (1196) [normal]: Recalculation step: 100000/200000
2025-02-05 13:17:23.4094 (1196) [normal]: Recalculation step: 120000/200000
2025-02-05 13:17:27.2264 (1196) [normal]: Recalculation step: 140000/200000
2025-02-05 13:17:31.0496 (1196) [normal]: Recalculation step: 160000/200000
2025-02-05 13:17:34.8734 (1196) [normal]: Recalculation step: 180000/200000
2025-02-05 13:17:38.6856 (1196) [normal]: Recalculation step: 200000/200000
2025-02-05 13:17:38.8951 (1196) [normal]: Finished recalculating toplist statistics.
2025-02-05 13:17:38.8951 (1196) [normal]: Finished in 1006.00 s with peak RAM usage: 1414.9 MB on CPU 'AMD Ryzen 7 2700X Eight-Core Processor         ', peak VRAM usage: 2044.6 MB on GPU Device: 'NVIDIA GeForce GTX 1660 SUPER' with backend: 'CUDA'.
2025-02-05 13:17:39.0411 (1196) [debug]: Writing output ... Closing temp output file '../../projects/einstein.phys.uwm.edu/h1_0180.80_O3aLC01Cl1In0__O3ASBu_181.00Hz_14994_0_0.tmp' ... renaming temp output file '../../projects/einstein.phys.uwm.edu/h1_0180.80_O3aLC01Cl1In0__O3ASBu_181.00Hz_14994_0_0.tmp' to '../../projects/einstein.phys.uwm.edu/h1_0180.80_O3aLC01Cl1In0__O3ASBu_181.00Hz_14994_0_0' ... done.
2025-02-05 13:17:39.2641 (1196) [normal]: Restarted from checkpoint 6281

DEPRECATION WARNING: program has invoked obsolete function FreeDopplerSkyScan(). Please see XLALDestroyDopplerSkyScan() for information about a replacement.
Code-version: %% LAL: 7.1.4.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALPulsar: 3.1.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)
%% LALApps: 7.3.0.1 (UNCLEAN d065dd0b1daca1f30b01d44a0f807e06f37b4958)

FPU status flags: 
2025-02-05 13:17:39.3459 (1196) [debug]: worker done. return(0) to caller
2025-02-05 13:17:39.3459 (1196) [normal]: done. calling boinc_finish(0).
13:17:39 (1196): called boinc_finish

</stderr_txt>
]]>