ligo-ex ligo-ds
  Richardson Lab Experimental Log, Page 15 of 16  Not logged in ELOG logo
ID Date Author Typedown Category Subject
  297   Wed Dec 20 10:33:34 2023 JonInfrastructureClean & BakeClean and bake lab migrated to 1129

Update: I have completed permanent routing of the electrical cables. I also ran the ultrasonic washer's drain line to the sink drain (the current hose does reach). The new clean and bake lab is now fully operational.

Quote:

[Jon, Tyler, Aiden, Luke]

On Friday we completed assembly of the new stainless steel-topped benches in 1129. We then moved the clean and bake equipment from 1119 to its new larger space in 1129. This included the HEPA flow bench, ultrasonic washer, deionized water drum, nitrogen tanks, and forced-convection oven. The oven was re-anchored to the wall with earthquake restraints in its new location.

The power cords still need to be permanently routed, but the new clean and bake lab is otherwise ready for use.

 

  303   Mon Jan 15 22:29:34 2024 JonInfrastructureGeneralCabinet installation & lab clean-up completed

[Jon, Tyler, Aiden, Shane, Pooyan, Michael, Cynthia, Luke]

On Wednesday, we completed long list of work towards making the new lab (1129) fully operational and enabling the next phase of FROSTI testing. 

Cabinet Installation

Three new VWR cabinets with sliding glass doors were installed in 1129. Each unit measures 48" (W) x 22" (D) x 84" (H) and sits along the back wall (see attachment 1). The 350-lb. cabinets were laid in place by Facilities on Monday and permanentized on Wednesday. Work included:

  • Earthquake anchoring to the masonry wall
  • Sliding glass doors leveled
  • Shelving installed
  • Wiping down of interior and exterior surfaces with IPA wipes

Server Rack Installation

A new Tripp Lite 42U open-frame rack was laid in place in 1129 and anchored to the floor (see attachment 1). This rack will house all of our general-purpose and simulation computers, which will be relocated from the 1119 rack at a later time.

Lab Clean-Up

Following installation of the new cabinets and rack, we proceeded to organize and clean both labs. Work included:

  • Moved parts and equipment into permanent storage in 1129 cabinets
  • Wiped down surfaces in 1119 and 1129 with polypropylene IPA wipes
  • HEPA-vacuumed floors of 1119 and 1129
  • Mopped floor in 1119 with Liquinox solution
  • Installed new sticky mats in 1119 and 1129
  • Regular cleanroom cleaning and particle counts (see 302)
  • Positioned new stainless steel gowning bench outside the cleanroom (see attachment 2)

At this point, the only piece of lab equipment still to be delivered is a HEPA garment cabinet for reusing our (semi-disposable) bunny suits. It is schedule to arrive in mid-February and will sit outside the cleanroom in 1119, in the former location of the HEPA flow bench.

  330   Tue Feb 20 08:01:30 2024 JonInfrastructureGeneralPower and network equipment installed in 1129 rack
[Jon, Tyler, Pooyan, Luis, Luke, Peter]

On Thursday we installed the power conditioning/distribution equipment and networking equipment in the new 1129 rack. The hardware is identical to the setup in the 1119 rack and includes:

  • Tripp Lite SU5KRT3UTF - 208V, 5kVA on-line UPS with 120V transformer
  • CyberPower PDU20M2F12R - metered power distribution unit, (14) NEMA 5-20R
  • Ubiquiti USW-Pro-48 - 48 port 10Gbps network switch

The UPS is connected to a 208V NEMA 6-30R outlet in the overhead cable tray, which is on the building's "standby" (backup power) circuit. An 8-ft L6-30 extension cord has been ordered to permanently run the power cable through the cable tray.

The network switch will be connected to a Cat6 cable that was recently run by ITS from the 1119 rack, allowing the lab's LAN to be extended into 1129. This Ethernet link remains to be tested.

Quote:

Server Rack Installation

A new Tripp Lite 42U open-frame rack was laid in place in 1129 and anchored to the floor (see attachment 1). This rack will house all of our general-purpose and simulation computers, which will be relocated from the 1119 rack at a later time.

  339   Sat Feb 24 08:53:38 2024 JonInfrastructureComputersMatlab upgraded to 2023b on Chimay
I upgraded Matlab on chimay to the latest stable release, 2023b. From some quick tests, it appears to be in working order. Let me know of any issues.
  377   Mon Jun 17 11:47:46 2024 LiuInfrastructureGeneralTemporary cooling units for the labs
Below are the temporary cooling units installed last week in labs 1119 and 1129. They are the temp. replacement for the building AC system, which will be shut down during the Physics roof replacement.
  379   Thu Jun 20 18:01:11 2024 JonInfrastructureComputersNew workstation ws3 in 1129
I have repurposed a spare Intel NUC to serve as the first of two planned workstations in 1129. Today I set it up with a fresh installation of Debian 12.5, assigned it the static IP address 192.168.1.15, and installed the LIGO CDS workstation packages. It is assigned the host name ws3. Temporarily, the mouse is borrowed from ws1 in 1119. We need to order another mouse as well as a 25-ft Ethernet cable for connecting the workstation to the 1129 switch, via the ceiling.
  382   Mon Jun 24 21:38:25 2024 PooyanInfrastructureComputersComputer server changes in 1119 and 1129

[Jon, Pooyan, Tyler]

 

A few computer machine changes have been made. 

 

  • Logrus moved from 1119 to 1129. It is up and running with the same IP address as before. 
  • A new Windows machine (host name: spica, IP:192.168.1.14) is installed in the 1119 server rack. It is connected to the RGA scanner with the serial port and is specifically used for that purpose. 
    • Update: The machine was off on 6/25, although it was left on 6/24. We think that it might have been because of Windows' default setting to suspend/hibernate the machine after idleness. To resolve this, I used  "powercfg /change" command to set all the following parameters equal to zero. The machine is still running on 6/26. 

    monitor-timeout-ac
    monitor-timeout-dc
    disk-timeout-ac
    disk-timeout-dc
    standby-timeout-ac
    standby-timeout-dc
    hibernate-timeout-ac
    hibernate-timeout-dc
  • A new Debian machine (hostname: megatron, IP:192.168.1.16) is installed in the 1129 server rack. This machine is intended to be used for FEA/simulation work. A new 2TB WD Green SSD is used as its main disk drive. 

     At the moment, “controls” is the only user, and there are no apps/libraries installed on the machine.

    • Update: Jon installed LIGO cds-workstation tools and MiniConda on 6/26. 
    • Update: Pooyan and Liu set the following conda environments:
      • Env named “finesse” with Python 3.12.3 and Finesse version 3.0a24 installed. Finesse was installed via the source code. The subdirectory “/home/controls/packages” is used to store the package sourcecodes.
      • Env named “fenicsx” with the same version of Python and Finesse as the previous env, with the latest version of FEniCSx (0.8) and the test-mass-thermal-state installed.  
  385   Wed Jun 26 15:33:41 2024 JonInfrastructureComputersNew workstation ws3 in 1129

Set-up of the first CDS workstation for 1129, ws3, is complete and the machine is ready for use. The login credentials are the same as the other lab machines.

All that now remains is to install a permanent cable tray for running the new Ethernet cables between the electronics rack and bench (they are currently dangling from the suspended lights).

Quote:
I have repurposed a spare Intel NUC to serve as the first of two planned workstations in 1129. Today I set it up with a fresh installation of Debian 12.5, assigned it the static IP address 192.168.1.15, and installed the LIGO CDS workstation packages. It is assigned the host name ws3. Temporarily, the mouse is borrowed from ws1 in 1119. We need to order another mouse as well as a 25-ft Ethernet cable for connecting the workstation to the 1129 switch, via the ceiling.

  402   Thu Jul 11 21:01:37 2024 JonInfrastructureGeneralCable tray installed in 1129
Today I installed a 10' cable tray in 1129, for permanently routing Ethernet lines to the workstations. It is securely bolted to C-channels in the side wall and in the center cable tray.
  412   Fri Jul 26 17:25:42 2024 JonInfrastructureComputersNew workstation ws4 installed in 1129

Today I installed the second desktop workstation in 1129. The new machine is an Intel NUC13ANHi5, with a 12-Core Intel i5-1340P CPU, 32GB DDR4 RAM, and a 1TB SSD.

I loaded it with a fresh installation of Debian 12 and installed the LIGO CDS workstation (control room) tools. It is assigned the hostname ws4 and and the static IP address 192.168.1.19 on the local lab network. Like the other CDS workstations, there is just one user account accessible with the usual credentials.

The machine is fully set up and ready for use.

  418   Tue Jul 30 07:42:47 2024 JonInfrastructureGeneralCable tray installed in 1119
Yesterday I installed another 5' cable tray in 1119, for permanently routing Ethernet lines to the L-bench. It is securely bolted to the top of the electronics rack, on one end, and to the top of the glass-door storage cabinet, on the other. This eliminates the need for the cable ramp which previously sat behind the rack.
  437   Mon Sep 9 14:27:36 2024 PooyanInfrastructureComputersChimay backup attempt

One ongoing work is to make all lab machines automatically backed-up on Scribe on a daily basis. The updates should be boatable and stored for some time (potentially a few weeks) on Scribe. Making whole disk images has already been tried for some of the machines with no problems. (e.g., Cymac and WorkStations)

The same thing can not be done with Chimay though, as it currently has one huge RAID-controlled volume that stores all the information (OS, home directories, and NDS-downloaded data). Creating daily full disk images of such a system is not practical. 

Here is the plan we came up with to overcome this issue:

  1. Create one full disk image of Chimay and store it on Scribe (it was already done)
  2. Move the nds-downloaded raw data temporarily to Scribe and remove it from Chimay
  3. Make another full disk image of Chimay
  4. Burn this image to a single disk and boot chimay with it
  5. Restore the rest of Chimay disks and move the NDS data back

     

On the weekend (Sat and Sun 9/7-8) I tried to execute these steps. There wasn't enough free space left on Scribe to move all the NDS data to it, so I stored part of this data temporarily on WS4. Then I also checked storage-consuming directories and, in one case, removed some non-important stored files. As there was no free space left on Scribe to execute step no. 3, I initiated storing the image on WS3. Unfortunately, a couple of different trials of the image-creation process failed as there was not enough free space on WS3 to accommodate Chiamy image as well. I was not able to reduce the image size such that it can be stored on WS3. 

 

These are the options left for us to get this work done. 

  1. Distribute the NDS files between different machines to make enough free space on Scribe for the image and then follow the previous plan
  2. Shrink the Chimay drive size, create the image and then follow the previous plan
  3. Temporarily transfer some services to Megatrone (Network gateway, Wiki, elog) and recreate chimay and its services from scratch
  578   Thu May 15 12:03:41 2025 Xuesi MaInfrastructureElectronicsNotice

All Sorensen power supplies are turned off. The Cymac system is down (All Chassis are down)

If you need more information or if you need to turn them back on please contact Xuesi Ma.

  579   Mon May 19 10:59:14 2025 Xuesi MaInfrastructure  

Status Update

Previous Status:

All Sorensen power supplies were turned off. The Cymac system was down (all chassis were offline).

If you need more information or assistance in turning them back on, please contact Xuesi Ma.


Update: The systems are now back online.

Note: The Sorensen power supplies’ voltage can now be controlled via channel VEXC8 of the DAC.

If scripting is required, the ezca Python package is highly recommended for interfacing and control.

  580   Wed May 21 14:40:38 2025 Xuesi MaInfrastructureCleanroomCleanroom Temperature

Date and Time: Around 2:20 PM on May 21, 2025

Location and Temperature:

  • Back of the room, around the working station: 85.5 °F
  • Front of the room, around the doorway: 82.3 °F
  589   Tue Jun 3 13:16:53 2025 Xuesi MaInfrastructure  

Date and Time: Around 3:50 PM on June 2, 2025

Location and Temperature:

  • Back of the room 1119, around the working station: 86 °F
  • Front of the room 1119, around the doorway: 84.1 °F
  • Back of the room 1129, around the working station: 78.6 °F
  • Front of the room 1129, around the doorway: 78.3 °F
  • In the hallway in front of room 1119: 75.2 °F
  613   Tue Jul 15 11:47:53 2025 Xuesi MaInfrastructure  

Date and Time: Around 4:50 PM on July 1, 2025

Location and Temperature:

  • Back of the room 1119, around the working station: 85.7 °F
  • Front of the room 1119, around the doorway: 83.5 °F
  • Back of the room 1129, around the working station: 79.1 °F
  • In the hallway in front of room 1119: 76.5 °F
  640   Tue Sep 2 18:33:38 2025 LiuInfrastructureGeneralNew lab room 1125 layout and measurement

Action items for facilities

 

  • Ceiling lights replacement
  • Fume hood cleaned and refurbished
  • Sink countertop cleaning
  • Floor cleaned and waxed
  •  
  651   Wed Oct 8 14:45:12 2025 Xuesi MaInfrastructureVACRGA Chamber Pressure
RGA Chamber pressure is currently at 3.68e-4 torr.
  662   Thu Nov 20 12:40:47 2025 Xuesi MaInfrastructureGeneralRoom 1125 Optical Table

Cleaned off the tapes on the optical table with acetone.

  670   Thu Jan 22 10:10:31 2026 JonInfrastructureGeneralLab floor plans
Attached are the starting and final floor plans for the February 2026 expansion into the Physics 1125 lab.
  672   Thu Jan 22 13:18:12 2026 PooyanInfrastructureGeneralLab floor plans

The working document of tasks regarding moving the clean room is attached. Needs LIGO account to access and edit.

  https://docs.google.com/document/d/14HhMYBcHmM62Hc1YJhinMsG5uPx6xoW0WEBmDcbNMMg/edit?usp=sharing

  676   Thu Feb 5 11:42:47 2026 JonInfrastructureGeneralLab floor plans

[Audrey, Cece, Jon, Ma, Mary, Michael, Pooyan, Tyler, Shane]

We have completed the preliminary reorganization of our Physics 1119 lab space. This includes:

  • Moving all cabinets to their final positions
  • Clearing out all equipment from the cleanroom in prep for HVAC work, and storing them in either the HEPA cabinet or double-bagging in regular storage.
  • Moving all non-essential equipment into other lab spaces.
  • Wrapping vacuum system and VLC for protection
  • Removing all ceiling tiles and fans from the ceiling of the cleanroom
  • Moving the cleanroom frame towards the front of the room.

Prepping the new clean-and-bake station in 1125 will begin within the next week, along with the construction of the stainless steel table planned to be put into the cleanroom.

Quote:
Attached are the starting and final floor plans for the February 2026 expansion into the Physics 1125 lab.

 

  682   Thu Feb 12 12:25:38 2026 Xuesi MaInfrastructureGeneralLab floor plans

[Cece, Ma, Mary, Pooyan, Tyler, Paul]

We have continued the reorganization of our Physics 1125 and 1129 lab spaces. This includes:

  • Moving two workbenches from Room 1129 into Room 1125
  • The workbench with the oven is still in Room 1129
  • Assembling the stainless steel table
  • Moving the cleanroom frame toward the whiteboard side to make room for HVAC work
  • The sink in Room 1125 was painted, and we stood Frosti up.

  689   Thu Mar 5 12:08:47 2026 PooyanInfrastructureCleanroomCleanroom HEPA fan defect

[Pooyan, Ma, Mary, Tyler]

While re-installing the clean-room HEPA fan filters, we realized that one of the blowers is broken. The issue seems to be that the plastic damper bracket that is keeping the blower in place has failed. The fix is to open up the fan unit, and replace the broken vibration damper. We installed the defected unit on top of the clean room entrance, for easy future access.

  691   Wed Mar 11 19:38:21 2026 PooyanInfrastructureCleanroomParts and things to get after the cleanroom move
  • concrete Caulk to fill the drill holes in 1119
    • Example [Pooyan: I have a caulk gun and silicon caulk at home, if needed.]
  • Water hose for the washer in 1125
    • 1/2" diameter
    • almost 8 Ft 
  • Exhaust for the oven in 1125
    • Question: not sure which way we want the exhaust to go. Measurements depend on the path. 
    • Oven exhaust to the ceiling vertical distance: 47"
    • Oven exhaust to the ceiling exhaust distance: 6 ft
  • Rubber vibration dampers for the cleanroom fans (see the first 4 pictures)
    • 25 mm diameter, 13 mm height, ~5-6 mm thread, 6 mm deep
    • Example (This is the male version. We need one with female on both sides)
  • Cabling conduit from the cable tray to the optical table frame (through the cleanroom ceiling)
  • Wire cable tray for 1125
    • ~10 Ft, exactly similar to the one already installed in 1129
  701   Sun Apr 19 15:22:08 2026 PooyanInfrastructureCleanroomHEPA fan air flow measurment

[Ma, Mary, Tyler, Pooyan]

HEPA fan air flow measurements are done with the fans sitting on their side in the lab, and the anemometer being 24in away from the filter face of the fan. Per company's documents, we need to replace the filter if the air flow velocity drops under 38-45 fpm for the medium settings.)
 

S/N Min Avg Max
P188642-2 118 121 125
118 119 125
P188642-3 53 79 88
43 48 53
P188642-12 43 61 88
15 42 53
P188642-1 80 83 88
43 49 80

All numbers are in fpm unit. The measurement for each unit is done twice in front of the fan positions.  

  708   Sun May 3 21:13:14 2026 PooyanInfrastructureCleanroomCleanroom HEPA fan install

[Ma, Cece, Pooyan, Tyler]

We installed the repaired HEPA fans on top of the cleanroom, and cleaned the fans themselves. The table of all the Serial Numbers for the fans, filters, and where they are installed is added for the record. 

 

No (See attached diagram) Fan S/N Filter S/N Position
I 6601-24-H-LP-P188642-12 P369462-307 East; Closest to entrance
II 6601-24-H-LP-P188642-3 P369462-256 Middle East
III 6601-24-H-LP-P188642-2 P369462-374 Middle West
IV 6601-24-H-LP-P188642-1 P369462-244 West; Closest to wire rack

 

The electrical wiring diagram of the cleanroom is on page (1) of the attached file.

  • Blue lines are protected by the lab UPS, and power the power strips attached to the frame of the optical tables. The same power strips feed the frame lights and the vacuum system. 
  • Red lines are connected to the red outlet on the celling cable tray, presumabaly connected to the building's backup system. The feed everything on the ceiling of the cleanroom by first going through two switches attached to the frame of the clean room. Each outlet feeds two fans and one ceiling lamp via power strips sitting on top of the cleanroom ceiling. (see pictures on page (2))

We will need two sets of conduits feeding cables into the cleanroom, possibly secured on the legs of the cleanroom frame and going through the ceiling tile.

  • The eastern conduit will have all of the connection/control/CyMAC cables, and two power cables. (See page (3))
  • The western conduit will have two power cables, and the table's air feeder. 
  • I suggest that each conduit be either a two inch wide, or two one inch wide coduits. Anything less than one inch wide will not be able to contain the current batch of chables. 

Page 4 is a possible cartoon of where we want to install the conduits. We can have electric boxes either on the both sides of the conduit, or just on one side. 

  717   Mon Jun 15 22:30:09 2026 Cece OchoaInfrastructureInventoryOptics Inventory
Spreadsheet of all tabletop optical parts in 1129 (Cabinet 1) linked here

Note that a couple of the optical posts still need to be measured for their diameters. Images are located in a Google Folder and linked on the spreadsheet so to view them you have to go to the Google Sheet.

  718   Thu Jun 18 08:40:07 2026 MaryInfrastructureGeneralFume hood
[Ma, Mary]
The tape residue on the fume hood was cleaned using acetone; however, the acetone caused minor paint removal. Few areas with rust were also found, including inside both side cabinets. under the fume hood.
  721   Thu Jun 25 12:48:29 2026 Xuesi MaInfrastructureCleanroom 
  729   Tue Jul 7 13:54:37 2026 Xuesi MaInfrastructureCleanroom 

[Shane, Joshua, Cece, Ma, Mary, Abhi, Jacob]

The clean room (1119) was re-cleaned on Thursday (7/2). All surfaces were wiped down, the floor was vacuumed and mopped, and new sticky mats were installed. Additionally, a particle count measurement was performed on Monday (7/6) after allowing sufficient time for dust to settle. As this is the first particle count conducted after the clean room modification, the updated clean room zone configuration is attached for reference.

Particle Count Measurements:

  • Zone 1:
    • 0.3 µm: 11556
    • 0.5 µm: 8563
    • 1.0 µm: 5237
  • Zone 2:
    • 0.3 µm: 1039
    • 0.5 µm: 623
    • 1.0 µm: 374
  • Zone 3:
    • 0.3 µm: 748
    • 0.5 µm: 290
    • 1.0 µm: 207
  • Zone 4:
    • 0.3 µm: 1829
    • 0.5 µm: 748
    • 1.0 µm: 374
  • Zone 5:
    • 0.3 µm: 1454
    • 0.5 µm: 665
    • 1.0 µm: 415

 

  732   Thu Jul 9 12:46:49 2026 Xuesi MaInfrastructureCleanroomCleanroom cleaning

[Shane, Joshua, Cece, Ma, Mary, Abhi, Jacob]

The clean room (1119) was re-cleaned on Tuesday (7/7). All surfaces were wiped down, and the wire rack was rewiped. A particle count measurement was performed on zone 1.

Particle Count Measurements:

  • Zone 1:
    • 0.3 µm: 5861
    • 0.5 µm: 2036
    • 1.0 µm: 249

 

  734   Tue Jul 14 21:23:40 2026 XuesiInfrastructureCleanroomCleanroom cleaning

[Joshua, Cece, Ma, Mary, Abhi, Jacob, Dhatri]

The clean room (1119) was re-cleaned on Tuesday (7/14). A particle count measurement was performed on zones 1, 3, and 5. We noticed the burning smell again in 1129. As a precaution, we closed the two doors separating the three rooms.

Particle Count Measurements:

  • Zone 1:
    • 0.3 µm: 4873
    • 0.5 µm: 1041
    • 1.0 µm: 124
  • Zone 3:
    • 0.3 µm: 708
    • 0.5 µm: 83
    • 1.0 µm: 83
  • Zone 5:
    • 0.3 µm: 4165
    • 0.5 µm: 1916
    • 1.0 µm: 583
  735   Wed Jul 15 21:53:32 2026 JoshuaInfrastructureCleanroomCleanroom cleaning

[Joshua, Mary, Ma]

On Wednesday (7/15), a particle count measurement was performed in the clean room in all five zones.

Particle Count Measurements:

  • Zone 1:
    • 0.3 µm: 958
    • 0.5 µm: 333
    • 1.0 µm: 240
  • Zone 2:
    • 0.3 µm: 541
    • 0.5 µm: 458
    • 1.0 µm: 416
  • Zone 3:
    • 0.3 µm: 624
    • 0.5 µm: 166
    • 1.0 µm: 83
  • Zone 4:
    • 0.3 µm: 958
    • 0.5 µm: 458
    • 1.0 µm: 124
  • Zone 5:
    • 0.3 µm: 2499
    • 0.5 µm: 1082
    • 1.0 µm: 499
  744   Mon Aug 3 12:23:03 2026 PooyanInfrastructureCDSCymac backup schedule

Backup plan for the CyMAC machine:

Cymac

  • Full image backup
    • Every Saturday at 3:00 am
    • One image for the whole machine. can be copied to a new disk and booted.
    • Only one version is kept
    • uses abb-cli on cymac. It’s the Synology agent script
    • Controlled by the Synology Active Backup for Business, Available in Scribe’s apps.
    • Image files are stored at `/volume1/ActiveBackupforBusiness/ActiveBackupData/Server-cymac-controls-Default` on Scribe
  • Things that will be periodically zipped and backed-up to Scribe
    • controls home directory
    • `/etc/advligorts/`
    • `/opt/`
    • Done weekly on Sundays at 4:00 am
    • Script at /opt/backup/weekly_zip.sh
    • cronjob at /etc/cron.d/cron.cymac
  • Things that will be periodically rsynced in the archive mode
    • `/frames`
    • Every night at 1 am
    • script at `/opt/backup`
    • cronjob at `/etc/cron.d/cron.cymac`
  • Biweekly purge of the raw frame files from the source (cymac)
    • on the 1st and the 15th of the month at 2:00 am
    • moves the raw frame files older than two weeks to Scribe, and removes them from the source

Schedule for Scribe:

  • Empty recycle bin every night at 1:00 am
    • Files that have been deleted more that 7 days ago will be permanently deleted
    • This is set in Synology control panel
  • Remove raw frames older than 2 months (60 days)
    • Script at /opt/backup/raw_purge.sh
      • Removes files from /volume1/Backups/cymac/full/
    • Runs every night at midnight to remove any raw frames older than 60 days
  755   Wed Oct 21 22:26:02 2026 PooyanInfrastructureComputersSystem updates

With two severe PHP vulnerabilities discovered earlier today, I updated some of our internet-facing machines and services to the latest version. Per my understanding, our main services are not even using PHP in their backend, so we shouldn't be worried. Either ways, it was a good excuse to update these machines. 

Updated systems: 

  • Chimay apt installed applications
    • This includes nginx which is our web-server
    • Had to update some of the repository names, since they had changed since the last update
  • Two Ubiquiti switches in 1119 & 1129 (USW-24-POE)
    • Our gateway router also needs updating, but I don't have the necessary permission to do that
  • Updated apt installed applications on these machines
    • megatron, elrond, ws1, ws2, ws3, ws4
  • Updated Foswiki plugins
    • I believe I also fixed the email registration problem. Should check at some point with a new registration.
    • Had to disable TablePlugin, as it had syntax in the source code in conflict with the RenderPlugin. This doesn't affect any of our tables.

 

 

 

Please let me know if you see any unintended changes from these updates. 

  757   Fri Oct 30 12:37:57 2026 Xuesi MaInfrastructureCleanroomHEPA Fan flow rate remeasurement

[Ma, Shane, Michael]

HEPA fan air flow measurements are done with the fans sitting on their side in the lab, and the anemometer being 24in away from the filter face of the fan. Per company's documents, we need to replace the filter if the air flow velocity drops under 38-45 fpm for the medium settings.)
 

S/N Min Avg Max
P188642-12 53 81 88
43 79 88

All numbers are in fpm unit. The measurement for each unit is done twice in front of the fan positions.  

  763   Fri Nov 6 10:17:04 2026 ShaneInfrastructureCleanroomCeiling Fan Flow Rate Tests
[Shane, Ma, Mary, Cece]
    We've finished 6-pt flow rate tests for all four cleanroom ceiling fans. Results are attached as pdf. All of the 6-pt tests were done with the fan speed on high, as the anemometer is only rated to resolve values above 80 fpm. Also attached here as a photo is a clearer digram of the measurement scheme, with description in the PDF.
  1   Sun Apr 10 15:39:49 2022 Rutuja GuravHowToComputer Scripts/ProgramsHowTo: Renew the Let's Encrypt SSL certificate using certbot

Port 80 is kept closed by default. This might be causing the certbot auto-renewal cronjob to fail. Therefore we must renew the certificate manually.


Step 1: Open port 80. (This is needed as the certificate renewal process runs some tests which requires client communication over port 80)


Step 2: Run the following command


sudo certbot certonly --force-renew -d richardsonlab.ucr.edu


Step 3: Confirm the certificate was renewed by running the following command


sudo certbot certificates

  2   Thu Jun 2 16:14:58 2022 JonHowToGeneralCustom conda environment on JupyterHub

Cross-linking instructions: How to run a Jupyter notebook in your custom Conda environment

  292   Fri Dec 15 14:03:02 2023 AidenHowToVACVacuum Chamber Opening
[Aiden]

1. Turn off the RGA filament and disconnect it.

2. Record the pressure and then close the angle valve and gate valve on the RGA line to isolate it from the system.

3. Turn off the backing and turbo pump and let the turbo pump spin to a stop by slowly leaking the chamber. The slower the safer.

4.Slowly open the vents on the chamber and the turbo pump. Making sure not to raise the pressure too fast.

5. Once done venting the chamber, open the lid by removing the bolts and prying the lid open with a long flat head screw driver.

6. Removed previous parts and placed them into clean bags. Place new parts inside of the chamber and group them together close to the center.

7. Place the lid back onto the chamber and tighten the bolts in a circular pattern until tightened all the way with the wrench.

8. Make sure all vents are closed and turn the backing pump back on.

9. The turbo pump can be turned back on when the pressure reaches e-1 torr.

10. Wait until the chamber reaches a pressure of e-6 torr before opening the angle and gate valve on the RGA line. After the RGA line is open and the pressure is still below e-6 torr, the RGA filament can be turned on and a leak test of the lid should be performed.

11. After the leak test shows no leaks, proceed with starting the low temp bake.

  555   Thu Apr 17 12:12:29 2025 LiuHowToInterferometer SimulationsPreventing Thread Contention in Multiprocessing with Finesse and Cython

Avoiding Thread Contention When Using Multiprocessing with Finesse and Cython

When running Monte Carlo simulations or other computational workloads, it's common to use Python's ProcessPoolExecutor to parallelize multiple independent tasks. This approach works well—until it interacts with low-level libraries that themselves use multi-threading under the hood.

The Problem: Thread Over-Subscription

In a recent project, I ran into a significant performance issue while executing a large number of Monte Carlo trials using a process pool with 30 worker processes on Megatron (with 48 cores). Each trial ran a function that internally used cython.parallel.prange for fast, element-wise operations, which is what Finesse uses under the hood for many internal numerical calculations. Cython, via OpenMP, was configured to use all available CPU threads per process by default.

This resulted in severe thread over-subscription. With 30 parallel processes and each process attempting to use all 48 threads, the system was launching over 1,400 threads concurrently. The CPU quickly became saturated, and the tasks stalled. In some cases, the system became unresponsive, and the jobs had to be canceled repeatedly.

This happens because when the function calls into these libraries from within a Python multiprocessing context, each subprocess will attempt to use the full number of threads available to the machine.

The Solution: Limit Threads per Process

The solution is simple: explicitly limit the number of threads each subprocess is allowed to use. This can be done by setting the environment variable at the top of your script, before importing any thread-hungry libraries like Finesse.

      
import os
os.environ["OMP_NUM_THREADS"] = "1"

    

By setting OMP_NUM_THREADS to "1", we ensure that each multiprocessing worker uses only one thread internally, preventing them from overloading the system and allowing the tasks to run more efficiently.

  14   Wed Dec 14 18:34:33 2022 JonConfigurationElectronicsAdapter for 532 nm laser power supply
I installed an EU-to-US plug adapter for the 532nm laser's 9V power supply. I then re-measured the laser's power with the correct supply voltage (previously we had been using a 6V supply). At 9V, the max power is 0.83 W, so the laser is confirmed to be Class 2 as labeled.
  271   Mon Nov 20 10:10:50 2023 TylerConfigurationElectronicsRTD Logic/Schematic Diagrams

Below are a basic diagram of what the RTD measurement circuit logically looks like and an example schematic of the actual wiring. The schematic wiring will be placed internally into a chassis, connected to the RTDs via DB25 cable.

Note: The DB25 Breakout Board connector is Female, not Male.
  298   Fri Dec 29 16:02:27 2023 JonConfigurationElectronicsRTD Readout Chassis

The custom front and rear panels for the RTD readout chassis arrived last Friday. I installed them in the chassis frame to check their fit. They fit very well, so all that now remains is to complete the internal wiring and test the connections.

The chassis panel designs are archived to LIGO-D2300452 and LIGO-D2300453.

Quote:

Below are a basic diagram of what the RTD measurement circuit logically looks like and an example schematic of the actual wiring. The schematic wiring will be placed internally into a chassis, connected to the RTDs via DB25 cable.

Note: The DB25 Breakout Board connector is Female, not Male.
  300   Tue Jan 9 12:08:59 2024 TylerConfigurationElectronicsRTD Readout Chassis Update

Below is the current state of the RTD readout chassis wiring. Initial continuity tests seem good, will run through one more time to confirm.

Quote:

The custom front and rear panels for the RTD readout chassis arrived last Friday. I installed them in the chassis frame to check their fit. They fit very well, so all that now remains is to complete the internal wiring and test the connections.

The chassis panel designs are archived to LIGO-D2300452 and LIGO-D2300453.

Quote:

Below are a basic diagram of what the RTD measurement circuit logically looks like and an example schematic of the actual wiring. The schematic wiring will be placed internally into a chassis, connected to the RTDs via DB25 cable.

Note: The DB25 Breakout Board connector is Female, not Male.

 

  305   Tue Jan 16 12:20:21 2024 TylerConfigurationElectronicsRTD Readout Chassis Update 2

I performed another continuity test on the RTD chassis wiring, and everything seems to be set up correctly. The chassis should be ready for installation.

Quote:

Below is the current state of the RTD readout chassis wiring. Initial continuity tests seem good, will run through one more time to confirm.

Quote:

The custom front and rear panels for the RTD readout chassis arrived last Friday. I installed them in the chassis frame to check their fit. They fit very well, so all that now remains is to complete the internal wiring and test the connections.

The chassis panel designs are archived to LIGO-D2300452 and LIGO-D2300453.

Quote:

Below are a basic diagram of what the RTD measurement circuit logically looks like and an example schematic of the actual wiring. The schematic wiring will be placed internally into a chassis, connected to the RTDs via DB25 cable.

Note: The DB25 Breakout Board connector is Female, not Male.

 

 

  323   Tue Feb 13 11:54:45 2024 TylerConfigurationFLIRIn-Air Optical Test Configuration

Below is the proposed schematic for FROSTI optical testing, chosen so enough space is allotted for prototype assembly.

Steps to be taken include:

  1. Reconstruct FLIR staging apparatus
  2. Move test mass stand-in to cleanroom
  3. Mark FLIR camera position on cleanroom optical table at correct distance
  4. Run ethernet cable into cleanroom
  5. Move FLIR aside to allow for more assembly space
  6. Upon assembly completion, reposition FLIR onto optical table again

Tentative plan is to begin setup early next week.

  451   Wed Oct 2 10:31:46 2024 Xuesi MaConfiguration Group Meeting Slides 10/2/2024

Group Meeting slides for Non-deterministic Heater Response.

ELOG V3.1.3-7933898