For a quick projection for the resonant frequencies going from aLIGO to CE, the height and width of the BS are increased assuming the mass is increased from 14 kg to 70 kg, while keeping the aspect ratio fixed. The resonant frequencies for the two mechanical modes as a result becomes smaller, to 1.43 kHz and 2.11 kHz respectively, risking getting in the detection band.

Next step is to implement a mechanical ring with high stiffness outside the BS barrel to combat the decrement of the resonant frequencies of the relevant mechanical modes.

This is to optimize the FROSTI heating profile for ETM, by minimizing the residual RMSE of the HR surface deformation after the beam size weighted curvature is removed by the current RH. The parameters of the profile being explored are the location, width, and total power for the Gaussian Annulus. As shown in the attached series of plots, the optimal location is 9.9 cm, with a width of 7.7 cm, and a total FROSTI power of 12.7 W (for 1 W of Gaussian beam absorption). The residual RMSE is 1.2 nm. About 0.5% of the FROSTI power is lost at the edges of the TM.

For comparison, without FROSTI, the residual RMSE after the beam size weighted curvature removed by the current RH is 44.5 nm. When the width of the Annulus is set to be 3 cm however, the residual RMS is 3.1 nm, with much smaller FROSTI power needed at 4.7 W, and less power loss at 0.02%.

Avoiding Thread Contention When Using Multiprocessing with Finesse and Cython

When running Monte Carlo simulations or other computational workloads, it's common to use Python's ProcessPoolExecutor to parallelize multiple independent tasks. This approach works well—until it interacts with low-level libraries that themselves use multi-threading under the hood.

The Problem: Thread Over-Subscription

In a recent project, I ran into a significant performance issue while executing a large number of Monte Carlo trials using a process pool with 30 worker processes on Megatron (with 48 cores). Each trial ran a function that internally used cython.parallel.prange for fast, element-wise operations, which is what Finesse uses under the hood for many internal numerical calculations. Cython, via OpenMP, was configured to use all available CPU threads per process by default.

This resulted in severe thread over-subscription. With 30 parallel processes and each process attempting to use all 48 threads, the system was launching over 1,400 threads concurrently. The CPU quickly became saturated, and the tasks stalled. In some cases, the system became unresponsive, and the jobs had to be canceled repeatedly.

This happens because when the function calls into these libraries from within a Python multiprocessing context, each subprocess will attempt to use the full number of threads available to the machine.

The Solution: Limit Threads per Process

The solution is simple: explicitly limit the number of threads each subprocess is allowed to use. This can be done by setting the environment variable at the top of your script, before importing any thread-hungry libraries like Finesse.

      
import os
os.environ["OMP_NUM_THREADS"] = "1"

    

By setting OMP_NUM_THREADS to "1", we ensure that each multiprocessing worker uses only one thread internally, preventing them from overloading the system and allowing the tasks to run more efficiently.

Action items for facilities

• Ceiling lights replacement
• Fume hood cleaned and refurbished
• Sink countertop cleaning
• Floor cleaned and waxed
•  

Today we started re-configuring the vacuum chamber components.

Particle count
• 10:45 am : Starting the particle count in the clean room.
• 11:13 am : Finished the particle count in the clean room.
• Zone 3 :
  • 0.3 u: 2535
  • 0.5 u: 1413
  • 1.0 u: 789
• Zone 4 :
  • 0.3 u: 457
  • 0.5 u: 290
  • 1.0 u: 207
  Starting the reconfiguration.
  • 11:21 am: Started removing up-to-air valve
  • 11:30 am: Finished removing up-to-air valve.
  • 11:33 am: Started removing calibrated Ar Leak and the elbow.
  • 11:35 am: Finished removing calibrated Ar Leak and started assembling the up-to-air valve.
  • 11:47 am: Finished assembling up-to-air valve.
  • 11:48 am: Started removing magnetron gauge.
  • 11:55 am: Finished removing magnetron gauge.
  • 11:57 am: Started installing the elbow and calibrated Ar Leak and started removing the RGA probe
  • 12:13 pm: Finished installing the elbow and calibrated Ar Leak.
  • 12:20 pm: Break for lunch.
  • 01:25 pm: Come back from lunch break.
  • 01:30 pm: Started removing RGA line.
  • 01:39 pm: Finished removing RGA line.
  • 01:39 pm: Started removing gate valve [RGA line] and finished removing gate valve.
  • 02:00 pm: Started installing gate valve in the new position.
  • 02:08 pm: Fished installing gate valve [RGA line].
  • 02:09 pm: Checked the screws in the elbow to gate valve. [RGA line].
  • 02:28 pm: Finished checking the screws in the elbow to gate valve [RGA line].
  • 02:29 pm: Started installing RGA line.
  • 02:39 pm: Finished installing RGA line.
  • 02:50 pm: Started installing magnetron gauge.(In this part we assembled gauge with the used gasket)
  • 03:02 pm: Finished installing magnetron gauge.
  • 03:04 pm: Started installing RGA probe [RGA line].
  • 03:13 pm: Finished installing RGA probe [RGA line].
  • 03:15 pm: Connected the cables to the magnetron gauge.
  • 03:20 pm: Started the testing in the vacuum chamber.
  • 04:30 pm: Started installing the RGA 200 and connected the cables (power cable and DB9 cable).
  • 04:52 pm: Finished installing the RGA 200 and connected the cables (power cable and DB9 cable).
  • 04:53 pm: Started testing the RGA connections. Logrus is able to recognize and connect to RGA unit. We are leaving the turbo pump on for a few hours before checking back for pressure readouts.
  • 05:00 pm : Starting the particle count in the clean room.
    1. Zone 3 :
       • 0.3 u: 2244
       • 0.5 u: 997
       • 1.0 u: 207
    2. Zone 4 :
       • 0.3 u: 2993
       • 0.5 u: 1579
       • 1.0 u: 498
  • 05:30 pm : Finished the particle count in the clean room.
  • 05:34 pm: Test pressure readout from the gauges.
    1. Channel 1 : 1.06E-5 mbar
    2. Channel 2 :8.89E-6 mbar
    3. Channel 3 :5.0E-4 mbar
  • 05:59 pm: Test pressure readout from the gauges.
    1. Channel 1: 9.09E-6 mbar
    2. Channel 2: 7.75E-6 mbar
    3. Channel 3: 5.0E-4 mbar

[Joshua, Mary, Ma]

On Wednesday (7/15), a particle count measurement was performed in the clean room in all five zones.

Particle Count Measurements:

• Zone 1:
  • 0.3 µm: 958
  • 0.5 µm: 333
  • 1.0 µm: 240
• Zone 2:
  • 0.3 µm: 541
  • 0.5 µm: 458
  • 1.0 µm: 416
• Zone 3:
  • 0.3 µm: 624
  • 0.5 µm: 166
  • 1.0 µm: 83
• Zone 4:
  • 0.3 µm: 958
  • 0.5 µm: 458
  • 1.0 µm: 124
• Zone 5:
  • 0.3 µm: 2499
  • 0.5 µm: 1082
  • 1.0 µm: 499

[Joshua, Mary, Ma, Abhi]

On Wednesday (7/15), the particle count measurement was sufficient, so the FROSTI was transferred into the cleanroom. We unmounted it from the plastic base, and secured it to the optical table. We also transferred the neccessary parts for the HBT setup and began assembly. The breadboard was built first (except for the lenses/beamsplitter) and mounted the the optical posts which will hold it. We placed the beamsplitter as close as possible to FROSTI without touching, and secured the feet. It is ready for the lenses/beamsplitter to be cleaned and placed in their mounts. Then we will align the setup for maximum power on the transmissive arm.

HBT setup was aligned for maximum power on the transmissive arm, then the beamsplitter was tilted to equalize the power in each arm. Then, we set the board at
Total power: 0.156 V
Power on each photodetector: 0.078 V
We left the FROSTI on and will collect data overnight. If we need more power, we can cut the breadboard notch further.

[Joshua, Mary]

This is a measurement done to determine which heating elements output the most power. FROSTI was supplied 33V, and a photodetector was held to the center of each heating element directly at the aperture.

Element #1 (top), RTD0 - 0.33 V
Element #2 (bottom right), RTD1 - 0.21 V
Element #3 (top left), RTD2 - 0.15 V
Element #4 (bottom), RTD3 - 0.33 V
Element #5 (bottom left), RTD4 - 0.31 V
Element #6 (right), RTD5 - 0.25 V
Element #7 (top right), RTD6 - 0.00 V (shorted)
Element #8 (left), RTD7 - 0.31

[Jon, Cao]

1. Re-routing of cables

We re-routed the connections between the turbo pump and its fan to the controller. Instead of going through the side of the server rack, they are now routed along the the cable tray and came down from the top of the server rack.

2. Planning for vacuum assembly re-configuration

• Move the entire RGA arm to the mirrored CF port, where the Up-to-Air valve is at
• Move the Up-to-Air valve to the calibrated leak port
• Move the calibrated Ar leak the main chamber full-range gauge port
• Move the full-range gauge to the RGA line port

3. First test pump-down

1. With all valves closed, we started scroll pump, pump line quickly got down to 6.08 mbar from atmospheric 1000 mbar (measured by Pirani gauge, channel 3 on controller )
2. We open Lesker angled valve and let the RGA arm pumped down, Pirani gauge read 6.3 mbar while the full-range guage on RGA line reads 4.9 mbar ( channel 1 on controller )
3. We open the pump line gate to expose the pump to the main volume, all gaugues readout immediate rise back up 1000 mbar. After 3 minutes, we started to see channel 3 slowly dropped down. A minute later channel 1 and 2 (main body) also dropped down. The slow pressure dropping speed and 6.3 mbar measured earlier got us suspected that there is some large leaks
4. We proceed to tighten all the ports as the vacuum is pumped down. In particular, we found that large feedthrough port still required a lot of tightening up
5. As we tighten up all the ports, after 40 minutes, the gauges are now
   • Channel 1 : RGA line full-range gauge: 2.55E-1 mbar
   • Channel 2 : Main chamber full-range gauge: 2.60E-1 mbar
   • Channel 3 : Pump line Pirani gauge: 2.94E-1 mbar
   Compare this to the scroll pump manual , Table 1, page 3, the ultimate pressure of the scroll pump is 2.5E-1 Torr (3.3E-1 mbar), we thus managed to achieve scroll pump ultimate pressure
6. Turn on turbo pump : Change turbo pump controller from REMOTE to FRONT PANEL mode by pressing both "COUNTERS" and "MEASURE" buttons at the same time, select "MODE=FRONT"
7. Shorting interlock pin: since we do not have an interlock signal for the controller, use the provided DB-9 connector that has pin 3 and 8 shorted and connect this to the P1 IN connection at the rear of the controller (see attachment 1 )
8. Press "START" on the controller to start the turbo pump
9. The pressure readout from the gauges quickly dropped down. After 3 minutes, the Pirani range is maxed out at 0.5E-3 mbar. After 20 minutes, we recorded the following values:
   • Channel 1 : RGA line full-range gauge: 1.50E-5 mbar
   • Channel 2 : Main chamber full-range gauge: 1.89E-5 mbar
   • Channel 3 : Pump line Pirani gauge: 5.0E-4 mbar
   This is Medium vacuum , we want to further reduce this by 2 orders of magnitude. However, we can run RGA test + helium leak test at this pressure
10. Turn off turbo pump, wait for 10 minutes, turn off scroll pump, open Up-to-Air valve, all pressure gauges indicated pressure returned back to atmospheric pressure

3. To-do actions

• Run RGA test to get information about contamination status of vacuum
• Implement suggested changes in section 2
• Check and modify suspected poor connection: Pirani gauge on pump line. A gap can be seen between connection. There's no good way to tighten it with the screw. Maybe use threaded pin + hex bolt?
• Controller communications

Summary : We resolved problems with heaters tripping power and were able to proceed with chamber baking

1. Circuit connection adjustment

After yesterday elog 137, today we resolved most of these issues. After Jon contacted Facilities, the LP3B 6 circuit was reset and the cleanroom filter & light panels resumed to work as normal.

Regarding the connection of the heaters. we made the following adjustments:

• High-temperature controller powering lid + upper volume heater: connect to LP3B 8 circuit (clean room sides, 2 outlets)
• High-temperature controller powering bottom + lower volume heater : connect to LP3B 4 circuit (workstation side, 2 outlets)

2. Replacement of vacuum nipple insulation

We had also received new insulation pieces from Worbo today to replace the existing insulation with the new ones (see images). These cover the 2 4" tubes (for 6" flanges ) and the 4 1.5" tubes (for 2.75" flanges). The new insulations fit perfectly on these tubes. I also placed all insulation taken off from the last elog back onto the chamber ( these are insulations for the pumps and RGA lines).

3. Baking

• Starting set point: 40 deg C
• Step increase: 10 deg C up to 80 deg C, 5 deg C from 80 deg to 120 deg C
• At each step, the temperature readouts show approx. 2.1 deg C overshooting, wait to settle back to approx 1.5 deg C overshoot before increase the set point again

The temperature of the chamber reached as stable 120 deg C without any power issues at 3:45 pm. I waited another 15 minutes to verify its stability and the official baking duration started at 4:00 pm Jun 29 2023. Since we are baking at 120 deg C instead of the standard 150 deg C for Aluminium, the duration for the bake will be over three days until Monday morning, upon which we will slowly ramp down the the temperature.