title: Characterizing randomness in parameterized quantum circuits through expressibility and average entanglement

abstract: While scalable error correction schemes and fault tolerant quantum computing seem not to be universally accessible in the near sight, the efforts of many researchers have been directed to the exploration of the contemporary available quantum hardware. Due to these limitations, the depth and dimension of the possible quantum circuits are restricted. This motivates the study of circuits with parameterized operations that can be classically optimized in hybrid methods as variational quantum algorithms (VQAs), enabling the reduction of circuit depth and size. The characteristics of these Parameterized Quantum Circuits (PQCs) are still not fully understood outside the scope of their principal application, motivating the study of their intrinsic properties. In this work, we analyse the generation of random states in PQCs under restrictions on the qubits connectivities, justified by different quantum computer architectures. We apply the expressibility quantifier and the average entanglement as diagnostics for the characteristics of the generated states and classify the circuits depending on the topology of the quantum computer where they can be implemented. As a function of the number of layers and qubits, circuits following a Ring topology will have the highest entanglement and expressibility values, followed by Linear/All-to-all almost together and the Star topology. In addition to the characterization of the differences between the entanglement and expressibility of these circuits, we also place a connection between how steep is the increase on the uniformity of the distribution of the generated states and the generation of entanglement. Circuits generating average and standard deviation for entanglement closer to values obtained with the truly uniformly random ensemble of unitaries present a steeper evolution when compared to others.


title: On the test-time zero-shot generalization of vision-language models: Do we really need prompt learning?

abstract: The development of large vision-language models, notably CLIP, has catalyzed research into effective adaptation techniques, with a particular focus on soft prompt tuning. Conjointly, test-time augmentation, which utilizes multiple augmented views of a single image to enhance zero-shot generalization, is emerging as a significant area of interest. This has predominantly directed research efforts toward test-time prompt tuning. In contrast, we introduce a robust MeanShift for Test-time Augmentation (MTA), which surpasses prompt-based methods without requiring this intensive training procedure. This positions MTA as an ideal solution for both standalone and API-based applications. Additionally, our method does not rely on ad hoc rules (e.g., confidence threshold) used in some previous test-time augmentation techniques to filter the augmented views. Instead, MTA incorporates a quality assessment variable for each view directly into its optimization process, termed as the inlierness score. This score is jointly optimized with a density mode seeking process, leading to an efficient training- and hyperparameter-free approach. We extensively benchmark our method on 15 datasets and demonstrate MTA's superiority and computational efficiency. Deployed easily as plug-and-play module on top of zero-shot models and state-of-the-art few-shot methods, MTA shows systematic and consistent improvements.


title: Structural Pruning of Pre-trained Language Models via Neural Architecture Search

abstract: Pre-trained language models (PLM), for example BERT or RoBERTa, mark the state-of-the-art for natural language understanding task when fine-tuned on labeled data. However, their large size poses challenges in deploying them for inference in real-world applications, due to significant GPU memory requirements and high inference latency. This paper explores neural architecture search (NAS) for structural pruning to find sub-parts of the fine-tuned network that optimally trade-off efficiency, for example in terms of model size or latency, and generalization performance. We also show how we can utilize more recently developed two-stage weight-sharing NAS approaches in this setting to accelerate the search process. Unlike traditional pruning methods with fixed thresholds, we propose to adopt a multi-objective approach that identifies the Pareto optimal set of sub-networks, allowing for a more flexible and automated compression process.


title: The injectivity radius of the compact Stiefel manifold under the Euclidean metric

abstract: The injectivity radius of a manifold is an important quantity, both from a theoretical point of view and in terms of numerical applications. It is the largest possible radius within which all geodesics are unique and length-minimizing. In consequence, it is the largest possible radius within which calculations in Riemannian normal coordinates are well-defined. A matrix manifold that arises frequently in a wide range of practical applications is the compact Stiefel manifold of orthogonal $p$-frames in $\mathbb{R}^n$. We observe that geodesics on this manifold are space curves of constant Frenet curvatures. Using this fact, we prove that the injectivity radius on the Stiefel manifold under the Euclidean metric is $\pi$.


title: On the structures of subset sums in higher dimension

abstract: A given subset $A$ of natural numbers is said to be complete if every element of $\N$ is the sum of distinct terms taken from $A$. This topic is strongly connected to the knapsack problem which is known to be NP complete. The main goal of the paper is to study the structure of subset sums in a higher dimension. We show 'dense' sets and generalized arithmetic progrssions in subset sums of certain sets.


title: On its way to the neutron star-white dwarf binary graveyard, IGR J16194-2810, a first ascent M giant X-ray binary

abstract: A single-lined spectroscopic orbit for the M giant in the X-ray binary IGR J16194-2810 is determined from a time-series of optical spectra. The spectroscopic orbital period of 192.5 days is twice that of the photometric period, confirming that the M giant in the system is an ellipsoidal variable. The giant is identified as a first ascent giant approaching the red giant tip. The primary is a neutron star (NS) with its M giant companion filling its Roche lobe verifying the system classification as a Low-Mass X-ray binary (LMXB). Stellar C, N, O and Fe abundances are derived for the M giant with the C, N, O values typical for a field giant with [Fe/H] = -0.14. The system does not have a large kick velocity. Models for the evolution of the system into a binary NS-white dwarf (WD) are presented. The X-ray properties are discussed in the context of this model. This binary is a rare example of a luminous, long orbital period, LMXB early in the transient ellipsoidal phase.


title: Local number fluctuations in ordered and disordered phases of water across temperatures: Higher-order moments and degrees of tetrahedrality

abstract: The isothermal compressibility (i.e., the asymptotic number variance) of equilibrium liquid water as a function of temperature is minimal near ambient conditions. This anomalous non-monotonic temperature dependence is due to a balance between thermal fluctuations and the formation of tetrahedral hydrogen-bond networks. Since tetrahedrality is a many-body property, it will also influence the higher-order moments of density fluctuations, including the skewness and kurtosis. To gain a more complete picture, we examine these higher-order moments that encapsulate many-body correlations using a recently developed, advanced platform for local density fluctuations. We study an extensive set of simulated phases of water across a range of temperatures (80 K to 1600 K) with various degrees of tetrahedrality, including ice phases, equilibrium liquid water, supercritical water, and disordered nonequilibrium quenches. We find clear signatures of tetrahedrality in the higher-order moments, including the skewness and excess kurtosis, that scale for all cases with the degree of tetrahedrality. More importantly, this scaling behavior leads to non-monotonic temperature dependencies in the higher-order moments for both equilibrium and non-equilibrium phases. Specifically, at near-ambient conditions, the higher-order moments vanish most rapidly for large length scales, and the distribution quickly converges to a Gaussian in our metric. However, at non-ambient conditions, higher-order moments vanish more slowly and hence become more relevant especially for improving information-theoretic approximations of hydrophobic solubility. The temperature non-monotonicity that we observe in the full distribution across length-scales could shed light on water's nested anomalies, i.e., reveal new links between structural, dynamic, and thermodynamic anomalies.


title: Mapping Cone and Morse Theory

abstract: On a smooth manifold, we associate to any closed differential form a mapping cone complex. The cohomology of this mapping cone complex can vary with the de Rham cohomology class of the closed form. We present a novel Morse theoretical description for the mapping cone cohomology. Specifically, we introduce a Morse complex for the mapping cone complex which is generated by pairs of critical points with the differential defined by gradient flows and an integration of the closed form over spaces of gradient flow lines. We prove that the cohomology of our cone Morse complex is isomorphic to the mapping cone cohomology and hence independent of both the Riemannian metric and the Morse function used to define the complex. We also obtain sharp inequalities that bound the dimension of the mapping cone cohomology in terms of the number of Morse critical points and the properties of the specified closed form. Our results are widely applicable, especially for any manifold equipped with a geometric structure described by a closed differential form. We also obtain a bound on the difference between the number of Morse critical points and the Betti numbers.


title: Transversely Projective Structures on Smooth Foliations on Surfaces

abstract: Brunella's classification implies that every smooth foliation on a compact complex surface admits a singular transversely projective structure. However, Biswas and Sorin's recent work shows that certain foliations on compact complex surfaces, despite possessing a singular transversely projective structure, do not admit a regular transversely projective structure. Here, we describe the smooth foliations on compact complex surfaces which fail to possess a regular transversely projective structure.


title: Early flash-ionization lines in SN 2024ggi revealed by high-resolution spectroscopy

abstract: We present an analysis of very early high-resolution spectroscopic observations of the nearby core-collapse (CC) supernova (SN) 2024ggi, a Type II SN that ocurred in the galaxy NGC 3621, at a distance of 7.11 Mpc ($z\approx0.002435$). These observations represent the earliest high-resolution spectroscopy of a CCSN ever made. We analyze the very early-phase spectroscopic evolution of SN 2024ggi obtained in a short interval at 26.6 and 33.8h after the SN first light. Observations were obtained with the high-resolution spectrograph MIKE ($R\approx22600-28000$) at the 6.5m Magellan Clay Telescope, located at the Las Campanas Observatory, during the night of 2024-04-12UT. We constrain emission line features in the early-phase spectroscopic evolution of SN 2024ggi. We analyze the evolution of main spectroscopic features and the occurrence of high-ionization emission lines, by estimating their full width at half maximum (FWHM), equivalent width (EW), and blueshift velocities. We then compare our results to other early-time observations of CCSNe. The spectra show strong and narrow features of Balmer emission lines and of high-ionization species of HeI, HeII, NIII, CIII, together with relatively broader emission features of NIV and CIV. Some of these features become broader or disappear in the interval of 8h, indicating the rapid changes in the early evolution of CCSNe flash-ionization features. The HeII, CIV, NIV and Balmer emission lines have asymmetric Lorentzian profiles, with the HeII $\lambda4686$ broad component showing blue wings that extends up to $\sim-1000$ km s$^{-1}$. We also measure a CSM expansion velocity of $\sim 79 \ \textrm{km} \ \textrm{s}^{-1}$ from the blueshift in the H$\alpha$ emission profile, and a total extinction in the line of sight of $E(B-V)=0.16$ mag. Finally, we note many similarities of SN 2024ggi to the early evolution of SN 2023ixf.


title: Gotzmann's persistence theorem for smooth projective toric varieties

abstract: Gotzmann's persistence theorem enables us to confirm the Hilbert polynomial of a subscheme of projective space by checking the Hilbert function in just two points, regardless of the dimension of the ambient space. We generalise this result to products of projective spaces, and then extend our result to any smooth projective toric variety. In the case of products of projective spaces, the number of points depends solely on the Picard rank of the ambient space, rather than on the dimension. For a more general smooth projective toric variety this number depends on the number of Hilbert basis elements of the nef cone.


title: Local insulator-to-superconductor transition in amorphous InO$_x$ films modulated by e-beam irradiation

abstract: We present a novel method enabling precise post-fabrication modulation of the electrical resistance in micrometer-scale regions of amorphous indium oxide (a-InO$_x$) films. By subjecting initially insulating films to an electron beam at room temperature, we demonstrate that the exposed region of the films becomes superconducting. The resultant superconducting transition temperature ($T_c$) is adjustable up to 2.8 K by changing the electron dose and accelerating voltage. This technique offers a compelling alternative to traditional a-InO$_x$ annealing methods for both fundamental investigations and practical applications. Moreover, it empowers independent adjustment of electrical properties across initially identical a-InO$_x$ samples on the same substrate, facilitating the creation of superconducting microstructures with precise $T_c$ control at the micrometer scale. The observed resistance modifications likely stem from photoreduction induced by X-ray and/or UV radiation emitted during electron beam interactions with the film and substrate.


title: An error-mitigated photonic quantum circuit Born machine

abstract: Generative machine learning models aim to learn the underlying distribution of the data in order to generate new samples. Quantum circuit Born machines (QCBMs) are a popular choice of quantum generative models, which are particularly well suited to near-term devices since they can be implemented on shallow circuits. Within the framework of photonic quantum computing, we design and simulate a QCBM that can be implemented with linear optics. We show that a newly developed error mitigation technique called recycling mitigation greatly improves the training of QCBMs in realistic scenarios with photon loss.


title: Mitigating photon loss in linear optical quantum circuits: classical postprocessing methods outperforming postselection

abstract: Photon loss rates set an effective upper limit on the size of computations that can be run on current linear optical quantum devices. We present a family of techniques to mitigate the effects of photon loss on both output probabilities and expectation values derived from noisy linear optical circuits composed of an input of $n$ photons, an $m$-mode interferometer, and $m$ single photon detectors. Central to these techniques is the construction of objects called recycled probabilities. Recycled probabilities are constructed from output statistics affected by loss, and are designed to amplify the signal of the ideal (lossless) probabilities. Classical postprocessing techniques then take recycled probabilities as input and output a set of loss-mitigated probabilities, or expectation values. We provide analytical and numerical evidence that these methods can be applied, up to large sample sizes, to produce more accurate outputs than those obtained from postselection - which is currently the standard method of coping with photon loss when sampling from discrete variable linear optical quantum circuits. In contrast, we provide strong evidence that the popular zero noise extrapolation technique cannot improve on on the performance of postselection for any photon loss rate.


title: How Rare are TESS Free-Floating Planets?

abstract: Recently, Kunimoto et al. claimed that a short-lived signal in the Transiting Exoplanet Survey Satellite (TESS) Sector 61 database was caused by a microlensing event with a terrestrial-mass free-floating planet (FFP) lens. In this study, we investigate TESS's ability to detect microlensing FFPs by considering the detailed source information (e.g., distance and radius), the TESS photometric accuracy, and finite-source effects. Using the FFP mass function from microlensing surveys toward the Galactic bulge, we find that only $0.0018$ microlensing events are expected to be detected in TESS Sector 61 for the entire planetary mass range. The reported signal is unlikely to be a real microlensing event, which is consistent with the evidence from the long-term OGLE data that the signal was likely due to a stellar flare. By extrapolating our result to fainter stars until $T = 16$ mag and adopting a possible optimized search algorithm, we find that only $\sim 1$ FFP events can be detected in the entire TESS mission within the first 7 years. Significant improvments of our understanding of FFPs still requires future satellite missions, such as Roman and Earth 2.0, which can detect thousands of FFPs.


title: DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videos

abstract: View-predictive generative models provide strong priors for lifting object-centric images and videos into 3D and 4D through rendering and score distillation objectives. A question then remains: what about lifting complete multi-object dynamic scenes? There are two challenges in this direction: First, rendering error gradients are often insufficient to recover fast object motion, and second, view predictive generative models work much better for objects than whole scenes, so, score distillation objectives cannot currently be applied at the scene level directly. We present DreamScene4D, the first approach to generate 3D dynamic scenes of multiple objects from monocular videos via 360-degree novel view synthesis. Our key insight is a "decompose-recompose" approach that factorizes the video scene into the background and object tracks, while also factorizing object motion into 3 components: object-centric deformation, object-to-world-frame transformation, and camera motion. Such decomposition permits rendering error gradients and object view-predictive models to recover object 3D completions and deformations while bounding box tracks guide the large object movements in the scene. We show extensive results on challenging DAVIS, Kubric, and self-captured videos with quantitative comparisons and a user preference study. Besides 4D scene generation, DreamScene4D obtains accurate 2D persistent point track by projecting the inferred 3D trajectories to 2D. We will release our code and hope our work will stimulate more research on fine-grained 4D understanding from videos.


title: Reviving Horndeski after GW170817 by Kaluza-Klein compactifications

abstract: The application of Horndeski theory/ Galileons for late time cosmology is heavily constrained by the strict coincidence in the speed of propagation of gravitational and electromagnetic waves. These constraints presuppose that the minimally coupled photon is not modified, not even at the scales where General Relativity (GR) may need modification. We find that the 4D Galileon obtained from a Kaluza-Klein compactification of its higher dimensional version is a natural unified modification of GR and electromagnetism with automatically "luminal" gravitational waves. This property follows without any fine tuning of Galileon potentials for a larger class of theories than previously thought. In particular, the $G_4$ potential is not constrained by the speed test and $G_5$ may also be present. In other words, some Galileon models that have been ruled out since the event GW170817 are, in fact, not necessarily constrained if they arise in 4D from compactifications of their higher dimensional Galileon counterparts. Besides their compelling luminality, the resulting vector Galileons are naturally $U(1)$ gauge invariant.


title: Modulational instability in a quasi-one-dimensional Bose-Einstein condensates

abstract: In this work, we investigate the modulational instability of plane wave solutions within a modified Gross-Pitaevskii equation framework. The equation features cubic and quartic nonlinearity. It models the behaviour of quasi-one-dimensional Bose-Einstein condensates in symmetric Bose-Bose mixtures of ultra-dilute cold atoms. Our study demonstrates the pivotal role of the competition between mean-field attractions and quantum fluctuation-induced repulsions. This competition significantly affects the emergence and evolution of modulational instability. By employing linear stability analysis, we identify the essential conditions that lead to modulational instability. We find that the stability of plane wave solutions significantly depends on the interaction among system parameters. Further development of the instability leads to the fragmentation of the BEC into a chain of quantum droplets. We calculated the quantity of quantum droplets generated during the nonlinear phase of the instability. Our analytical results are corroborated by numerical simulations of the modified quasi-1D Gross-Pitaevskii equation. These simulations vividly depict the formation, interaction, and coalescence of droplets during the nonlinear phase of modulational instability. The investigation shows that linear stability analysis of the modified Gross-Pitaevskii equation, considering quantum fluctuations, precisely forecasts modulational instability phenomena across different domains of parameter spaces.


title: Thermodynamic constraints and exact scaling exponents of flocking matter

abstract: We use advances in the formalism of boost agnostic passive fluids to constrain transport in polar active fluids, which are subsequently described by the Toner-Tu equations. Acknowledging that the system fundamentally breaks boost symmetry we compel what were previously entirely phenomenological parameters in the Toner-Tu model to satisfy precise relationships among themselves. Consequently, we propose a thermodynamic argument to determine the exact scalings of the transport coefficients under dynamical renormalisation group flow. These scalings perfectly agree with the results of recent state-of-the-art numerical simulation and experiments


title: Study of energy backflow in unidirectional monochromatic and space-time waves

abstract: Backflow, or retropropagation, is a counterintuitive phenomenon whereby for a forward-propagating wave the energy locally propagates backward. In this study, energy backflow has been examined in connection with (a) (2+1)-dimensional unidirectional scalar and vector-valued monochromatic waves; (b) a (2+1)D scalar spatiotemporal wavepacket constructed by using an appropriate temporal frequency spectrum; (c) a scalar closed-form analytical unidirectional version of the Focus Wave Mode -- a localized pulse propagating luminally and without spread. Furthermore, an extended class of (2+1)D and (3+1)D finite-energy unidirectional spatiotemporally localized wave packets has been derived.


title: Special matrices over finite fields and their applications to quantum error-correcting codes

abstract: The matrix-product (MP) code $\mathcal{C}_{A,k}:=[\mathcal{C}_{1},\mathcal{C}_{2},\ldots,\mathcal{C}_{k}]\cdot A$ with a non-singular by column (NSC) matrix $A$ plays an important role in constructing good quantum error-correcting codes. In this paper, we study the MP code when the defining matrix $A$ satisfies the condition that $AA^{\dag}$ is $(D,\tau)$-monomial. We give an explicit formula for calculating the dimension of the Hermitian hull of a MP code. We provide the necessary and sufficient conditions that a MP code is Hermitian dual-containing (HDC), almost Hermitian dual-containing (AHDC), Hermitian self-orthogonal (HSO), almost Hermitian self-orthogonal (AHSO), and Hermitian LCD, respectively. We theoretically determine the number of all possible ways involving the relationships among the constituent codes to yield a MP code with these properties, respectively. We give alternative necessary and sufficient conditions for a MP code to be AHDC and AHSO, respectively, and show several cases where a MP code is not AHDC or AHSO. We provide the construction methods of HDC and AHDC MP codes, including those with optimal minimum distance lower bounds.


title: Accurate standard siren cosmology with joint gravitational-wave and $\gamma$-ray burst observations

abstract: Joint gravitational-wave and $\gamma$-ray bursts (GRB) observations are among the best prospects for standard siren cosmology. However, the strong selection effect for the coincident GRB detection, which is possible only for sources with small inclination angles, induces a systematic uncertainty that is currently not accounted for. We show that this severe source of bias can be removed by inferring the a-priori unknown electromagnetic detection probability directly from multimessenger data. This leads at the same time to an unbiased measurement of the Hubble constant, to constrain the properties of GRB emission, and to accurately measure the viewing angle of each source. Our inference scheme is applicable to real data already in the small-statistics regime, a scenario that might become reality in the near future. Additionally, we introduce a novel likelihood approximant for GW events which treats the dependence on distance and inclination as exact.


title: Vibe-Eval: A hard evaluation suite for measuring progress of multimodal language models

abstract: We introduce Vibe-Eval: a new open benchmark and framework for evaluating multimodal chat models. Vibe-Eval consists of 269 visual understanding prompts, including 100 of hard difficulty, complete with gold-standard responses authored by experts. Vibe-Eval is open-ended and challenging with dual objectives: (i) vibe checking multimodal chat models for day-to-day tasks and (ii) rigorously testing and probing the capabilities of present frontier models. Notably, our hard set contains >50% questions that all frontier models answer incorrectly. We explore the nuances of designing, evaluating, and ranking models on ultra challenging prompts. We also discuss trade-offs between human and automatic evaluation, and show that automatic model evaluation using Reka Core roughly correlates to human judgment. We offer free API access for the purpose of lightweight evaluation and plan to conduct formal human evaluations for public models that perform well on the Vibe-Eval's automatic scores. We release the evaluation code and data, see https://github.com/reka-ai/reka-vibe-eval


title: Prospective Role of Foundation Models in Advancing Autonomous Vehicles

abstract: With the development of artificial intelligence and breakthroughs in deep learning, large-scale Foundation Models (FMs), such as GPT, Sora, etc., have achieved remarkable results in many fields including natural language processing and computer vision. The application of FMs in autonomous driving holds considerable promise. For example, they can contribute to enhancing scene understanding and reasoning. By pre-training on rich linguistic and visual data, FMs can understand and interpret various elements in a driving scene, and provide cognitive reasoning to give linguistic and action instructions for driving decisions and planning. Furthermore, FMs can augment data based on the understanding of driving scenarios to provide feasible scenes of those rare occurrences in the long tail distribution that are unlikely to be encountered during routine driving and data collection. The enhancement can subsequently lead to improvement in the accuracy and reliability of autonomous driving systems. Another testament to the potential of FMs' applications lies in World Models, exemplified by the DREAMER series, which showcases the ability to comprehend physical laws and dynamics. Learning from massive data under the paradigm of self-supervised learning, World Model can generate unseen yet plausible driving environments, facilitating the enhancement in the prediction of road users' behaviors and the off-line training of driving strategies. In this paper, we synthesize the applications and future trends of FMs in autonomous driving. By utilizing the powerful capabilities of FMs, we strive to tackle the potential issues stemming from the long-tail distribution in autonomous driving, consequently advancing overall safety in this domain.


title: TSDiT: Traffic Scene Diffusion Models With Transformers

abstract: In this paper, we introduce a novel approach to trajectory generation for autonomous driving, combining the strengths of Diffusion models and Transformers. First, we use the historical trajectory data for efficient preprocessing and generate action latent using a diffusion model with DiT(Diffusion with Transformers) Blocks to increase scene diversity and stochasticity of agent actions. Then, we combine action latent, historical trajectories and HD Map features and put them into different transformer blocks. Finally, we use a trajectory decoder to generate future trajectories of agents in the traffic scene. The method exhibits superior performance in generating smooth turning trajectories, enhancing the model's capability to fit complex steering patterns. The experimental results demonstrate the effectiveness of our method in producing realistic and diverse trajectories, showcasing its potential for application in autonomous vehicle navigation systems.


title: Wheel Odometry-Based Localization for Autonomous Wheelchair

abstract: Localization is a fundamental requirement for an autonomous vehicle system. One of the most often used systems for autonomous vehicle localization is the global positioning system (GPS). Nevertheless, the functionality of GPS is strongly dependent on the availability of satellites, making it unreliable in some situations. As a result, autonomous vehicles must possess autonomous self-localization capabilities to ensure their independent operation. Odometry techniques are employed to achieve vehicle localization by predicting the vehicle position and orientation based on sensor measurements of the vehicle motion. One of the approaches employed in odometry is known as wheel odometry. Wheel odometry has a lower degree of reliance on the surrounding environment than visual odometry and laser odometry. This study aims to evaluate the performance of wheel odometry implementation for an autonomous wheelchair in the context of the localization process. The differential drive kinematic model is employed to determine the predicted pose of a wheelchair. This prediction is derived from the measurement of the linear and angular velocity of the wheelchair. Several experiments have been conducted to evaluate the performance of wheel odometry-based localization. Prior to experimenting, calibration procedures have also been performed to ensure accurate measurements of the sensor.


title: Bundling and Tumbling in Bacterial-inspired Bi-flagellated Soft Robots for Attitude Adjustment

abstract: We create a mechanism inspired by bacterial swimmers, featuring two flexible flagella with individual control over rotation speed and direction in viscous fluid environments. Using readily available materials, we design and fabricate silicone-based helical flagella. To simulate the robot's motion, we develop a physics-based computational tool, drawing inspiration from computer graphics. The framework incorporates the Discrete Elastic Rod method, modeling the flagella as Kirchhoff's elastic rods, and couples it with the Regularized Stokeslet Segments method for hydrodynamics, along with the Implicit Contact Model to handle contact. This approach effectively captures polymorphic phenomena like bundling and tumbling. Our study reveals how these emergent behaviors affect the robot's attitude angles, demonstrating its ability to self-reorient in both simulations and experiments. We anticipate that this framework will enhance our understanding of the directional change capabilities of flagellated robots, potentially stimulating further exploration on microscopic robot mobility.


title: ALOHA 2: An Enhanced Low-Cost Hardware for Bimanual Teleoperation

abstract: Diverse demonstration datasets have powered significant advances in robot learning, but the dexterity and scale of such data can be limited by the hardware cost, the hardware robustness, and the ease of teleoperation. We introduce ALOHA 2, an enhanced version of ALOHA that has greater performance, ergonomics, and robustness compared to the original design. To accelerate research in large-scale bimanual manipulation, we open source all hardware designs of ALOHA 2 with a detailed tutorial, together with a MuJoCo model of ALOHA 2 with system identification. See the project website at aloha-2.github.io.


title: Modified OSD Algorithm with Reduced Gaussian Elimination

abstract: In this paper, the OSD algorithm is modified to perform a limited GE with $O(N^3 \min\{R, 1-R\}^3)$ complexity for an $(N,K)$ linear block code of rate $R=K/N$.


title: Servo-based light shutters with Arduino control

abstract: In optical experiments, shutters are devices that open or close a path of light. They are often used to limit the duration of light exposure onto a target or onto a detector in order to reduce possible light-induced damage. Many commercial shutters are available for different applications - some provide very fast opening and closing times, some can handle large optical powers, and others allow for fail-safe operation. Many of these devices are costly and offer limited control options. Here we provide an open-source design for a low-cost, general purpose shutter system based on ubiquitous servo motors that are connected to an Arduino-based controller. Several shutters can be controlled by one controller, further reducing system cost. The state of the shutters can be controlled via a display built into the controller, by serial commands via USB, or by electrical control lines. The use of a microcontroller makes the shutter controller adaptable - only control options that are used need to be included, and the design accommodates a selection of display and servo options. We provide designs for all required components, including 3D print files for the servo holders and cases, software for the Arduino, libraries for serial communication (C and python), and example graphical user interfaces for testing.


title: Neural Additive Image Model: Interpretation through Interpolation

abstract: Understanding how images influence the world, interpreting which effects their semantics have on various quantities and exploring the reasons behind changes in image-based predictions are highly difficult yet extremely interesting problems. By adopting a holistic modeling approach utilizing Neural Additive Models in combination with Diffusion Autoencoders, we can effectively identify the latent hidden semantics of image effects and achieve full intelligibility of additional tabular effects. Our approach offers a high degree of flexibility, empowering us to comprehensively explore the impact of various image characteristics. We demonstrate that the proposed method can precisely identify complex image effects in an ablation study. To further showcase the practical applicability of our proposed model, we conduct a case study in which we investigate how the distinctive features and attributes captured within host images exert influence on the pricing of Airbnb rentals.


title: M\"obius Transform for Mitigating Perspective Distortions in Representation Learning

abstract: Perspective distortion (PD) causes unprecedented changes in shape, size, orientation, angles, and other spatial relationships of visual concepts in images. Precisely estimating camera intrinsic and extrinsic parameters is a challenging task that prevents synthesizing perspective distortion. Non-availability of dedicated training data poses a critical barrier to developing robust computer vision methods. Additionally, distortion correction methods make other computer vision tasks a multi-step approach and lack performance. In this work, we propose mitigating perspective distortion (MPD) by employing a fine-grained parameter control on a specific family of M\"obius transform to model real-world distortion without estimating camera intrinsic and extrinsic parameters and without the need for actual distorted data. Also, we present a dedicated perspectively distorted benchmark dataset, ImageNet-PD, to benchmark the robustness of deep learning models against this new dataset. The proposed method outperforms on existing benchmarks, ImageNet-E and ImageNet-X. Additionally, it significantly improves performance on ImageNet-PD while consistently performing on standard data distribution. Further, our method shows improved performance on three PD-affected real-world applications: crowd counting, fisheye image recognition, and person re-identification. We will release source code, dataset, and models for foster further research.


title: Employing Universal Voting Schemes for Improved Visual Place Recognition Performance

abstract: Visual Place Recognition has been the subject of many endeavours utilizing different ensemble approaches to improve VPR performance. Ideas like multi-process fusion, Fly-Inspired Voting Units, SwitchHit or Switch-Fuse involve combining different VPR techniques together, utilizing different strategies. However, a major aspect often common to many of these strategies is voting. Voting is an extremely relevant topic to explore in terms of its application and significance for any ensemble VPR setup. This paper analyses several voting schemes to maximise the place detection accuracy of a VPR ensemble set up and determine the optimal voting schemes for selection. We take inspiration from a variety of voting schemes that are widely employed in fields such as politics and sociology and it is evident via empirical data that the selection of the voting method influences the results drastically. The paper tests a wide variety of voting schemes to present the improvement in the VPR results for several data sets. We aim to determine whether a single optimal voting scheme exists or, much like in other fields of research, the selection of a voting technique is relative to its application and environment. We propose a ranking of these different voting methods from best to worst which allows for better selection. While presenting our results in terms of voting method's performance bounds, in form of radar charts, PR curves to showcase the difference in performance and a comparison methodology using a McNemar test variant to determine the statistical significance of the differences. This test is performed to further confirm the reliability of outcomes and draw comparisons for better and informed selection a voting technique.


title: Development and Validation of an Artificial Neural Network for the Recognition of Custom Dataset with YOLOv4

abstract: The expanding applications, utilized by more users, enhance hardware performance and further develop cloud systems for big data processing. This leads to numerous unexplored deep learning applications, especially in advanced computer vision for object recognition. Deep learning in image processing encompasses varied tasks from recognizing elements with diverse shapes and sizes to complex element classification, coping with varying backgrounds and lighting conditions, and text recognition. Its advantages lie in robust setup and high performance for recognizing complex elements. This work aims to develop a deep learning-based detection system for automated recognition of assembly components differing in geometry, size, contour, or color. Implementing the YOLOv4 algorithm, the system detects components based on their characteristics. Testing with 13 components involves capturing them in different orientations, numbers, individual parts, or assembled groups using a Raspberry Pi microcontroller and camera. Evaluation focuses on correct object recognition, confidence values, different compositions, distances between objects, and environmental factors affecting system quality. Results show positive object recognition across all scenarios, irrespective of orientation or number of objects. Even densely packed objects are correctly recognized with high confidence (97-100%). Lighting conditions don't significantly impact results, and all objects are properly labeled. The developed system is suitable for real-time two-dimensional component detection, with potential for extension to three-dimensional analysis using multiple cameras with varied positioning and views.


title: Deep Reinforcement Learning for Modelling Protein Complexes

abstract: AlphaFold can be used for both single-chain and multi-chain protein structure prediction, while the latter becomes extremely challenging as the number of chains increases. In this work, by taking each chain as a node and assembly actions as edges, we show that an acyclic undirected connected graph can be used to predict the structure of multi-chain protein complexes (a.k.a., protein complex modelling, PCM). However, there are still two challenges: 1) The huge combinatorial optimization space of $N^{N-2}$ ($N$ is the number of chains) for the PCM problem can easily lead to high computational cost. 2) The scales of protein complexes exhibit distribution shift due to variance in chain numbers, which calls for the generalization in modelling complexes of various scales. To address these challenges, we propose GAPN, a Generative Adversarial Policy Network powered by domain-specific rewards and adversarial loss through policy gradient for automatic PCM prediction. Specifically, GAPN learns to efficiently search through the immense assembly space and optimize the direct docking reward through policy gradient. Importantly, we design an adversarial reward function to enhance the receptive field of our model. In this way, GAPN will simultaneously focus on a specific batch of complexes and the global assembly rules learned from complexes with varied chain numbers. Empirically, we have achieved both significant accuracy (measured by RMSD and TM-Score) and efficiency improvements compared to leading PCM softwares.


title: Estimation of waveform deformation with the matched filter

abstract: In many particle physics experiments the data processing is based on the analysis of the digitized waveforms provided by the detector. While the waveform amplitude is usually correlated to the event energy, the shape may carry useful information for event discrimination. Thanks to the high signal to noise ratio they provide, matched filters are often applied. Their original design is however intended for the estimation of the waveform amplitude only. In this work we introduce an analytical extension of the original matched filter for the estimation of a possible shape deformation with respect to a reference template. The new filter is validated on simulations and, with respect to shape parameters calculated on unfiltered waveforms or derived from the original matched filter, it improves the discrimination capability by at least a factor 2 both at low and high signal to noise ratios, making it applicable to the data of several experiments.


title: TFCounter:Polishing Gems for Training-Free Object Counting

abstract: Object counting is a challenging task with broad application prospects in security surveillance, traffic management, and disease diagnosis. Existing object counting methods face a tri-fold challenge: achieving superior performance, maintaining high generalizability, and minimizing annotation costs. We develop a novel training-free class-agnostic object counter, TFCounter, which is prompt-context-aware via the cascade of the essential elements in large-scale foundation models. This approach employs an iterative counting framework with a dual prompt system to recognize a broader spectrum of objects varying in shape, appearance, and size. Besides, it introduces an innovative context-aware similarity module incorporating background context to enhance accuracy within messy scenes. To demonstrate cross-domain generalizability, we collect a novel counting dataset named BIKE-1000, including exclusive 1000 images of shared bicycles from Meituan. Extensive experiments on FSC-147, CARPK, and BIKE-1000 datasets demonstrate that TFCounter outperforms existing leading training-free methods and exhibits competitive results compared to trained counterparts.


title: The Democratization of Wealth Management: Hedged Mutual Fund Blockchain Protocol

abstract: We develop several innovations designed to bring the best practices of traditional investment funds to the blockchain landscape. Our innovations combine the superior mechanisms of mutual funds and hedge funds. Specifically, we illustrate how fund prices can be updated regularly like mutual funds and performance fees can be charged like hedge funds. We show how mutually hedged blockchain investment funds can operate with investor protection schemes - high water marks - and measures to offset trading slippage when redemptions happen. We provide detailed steps - including mathematical formulations and instructive pointers - to implement these ideas as blockchain smart contracts. We discuss how our designs overcome several blockchain bottlenecks and how we can make smart contracts smarter. We provide numerical illustrations of several scenarios related to the mechanisms we have tailored for blockchain implementation. The concepts we have developed for blockchain implementation can also be useful in traditional financial funds to calculate performance fees in a simplified manner. We highlight two main issues with the operation of mutual funds and hedge funds and show how blockchain technology can alleviate those concerns. The ideas developed here illustrate on one hand, how blockchain can solve many issues faced by the traditional world and on the other hand, how many innovations from traditional finance can benefit decentralized finance and speed its adoption. This becomes an example of symbiosis between decentralized and traditional finance - bringing these two realms closer and breaking down barriers between such artificial distinctions - wherein the future will be about providing better risk adjusted wealth appreciation opportunities to end customers through secure, reliable, accessible and transparent services - without getting too caught up about how such services are being rendered.

categories: cs.CR q-fin.CP q-fin.PM q-fin.RM q-fin.TR


title: Enhanced Thermal Management in High-Temperature Applications: Design and Optimization of a Water-Cooled Forced Convection System in a Hollow Cuboid Vapour Chamber Using COMSOL and MATLAB

abstract: This report details the design and optimisation of a water-cooled forced convection heat dissipation system for use in high-temperature applications (ranges between 700 degrees - 1000 degrees K). A hollow cuboid vapour chamber model was investigated. The space within the hollow cuboid was used as the design space. COMSOL, a FEM software product was used to solve for the physical parameters of each geometry for the heat dissipation system design space. COMSOL in conjunction with MATLAB was used for the parametric and density-based topology optimisation of the geometric design in the design space. The goal of the optimization is the minimisation of a temperature gradient over the design space. This allows the heat to be evenly spread throughout the designed mesh which allows for more effective cooling. To reduce the computational time needed to solve and optimise each geometry in 3D, a 2D representation was created for the front and rear faces of the hollow cuboid setup. These 2D face designs were then extrapolated into 3D over the length of the hollow cube and COMSOL was used to find a solution for each model. This report also proposes a use case for this system wherein it would be used in conjunction with MGA and thermometric technology within coal-fired power stations for the extraction and storage of waste heat for later use.


title: High-finesse nanofiber Fabry-P\'{e}rot resonator in a portable storage container

abstract: We present characterization and storage methods for a high-finesse nanofiber Fabry-P\'{e}rot resonator. Reflection spectroscopy from both ends of the resonator allows for evaluation of the mirror transmittances and optical loss inside the resonator. To maintain the quality of the nanofiber resonator after the fabrication, we have developed a portable storage container. By filling the container with dry, clean nitrogen gas, we can prevent contamination of the nanofiber during storage. This approach allows us to minimize the additional optical loss to less than 0.08% over a week. The portable container facilitates both the fabrication and subsequent experimentation with the resonator in different locations. This flexibility expands the range of applications, including quantum optics, communication, and sensing.


title: Inserting Faces inside Captions: Image Captioning with Attention Guided Merging

abstract: Image captioning models are widely used to describe recent and archived pictures with the objective of improving their accessibility and retrieval. Yet, these approaches tend to be inefficient and biased at retrieving people's names. In this work we introduce AstroCaptions, a dataset for the image captioning task. This dataset specifically contains thousands of public fig-ures that are complex to identify for a traditional model. We also propose a novel post-processing method to insert identified people's names inside the caption using explainable AI tools and the grounding capabilities of vi-sion-language models. The results obtained with this method show signifi-cant improvements of captions quality and a potential of reducing halluci-nations. Up to 93.2% of the persons detected can be inserted in the image captions leading to improvements in the BLEU, ROUGE, CIDEr and METEOR scores of each captioning model.


title: A compact and open-source microcontroller-based rapid auto-alignment system

abstract: Maintaining stable and precise alignment of a laser beam is crucial in many optical setups. In this work, we present a microcontroller-based rapid auto-alignment system that detects and corrects for drifts in a laser beam trajectory using a pair of two-dimensional duo-lateral position sensing detectors (PSDs) and a pair of mirror mounts with piezoelectric actuators. We develop hardware and software for interfacing with the PSDs and for controlling the motion of the piezoelectric mirrors mounts. Our auto-alignment strategy -- implemented as a state machine on the microcontroller by a FreeRTOS kernel -- is based on a simple linearized geometrical optical model. We benchmark our system using the standard case of coupling laser light efficiently into the guided mode of a single-mode fiber optic patch cable. We can recover the maximum fiber coupling efficiency in $\sim10$ seconds, even for a laser beam that was misaligned to the point of zero fiber coupling.


title: Helium Detection in Technical Materials

abstract: Materials used to study nuclear fusion can retain atmospheric helium unless pretreated before an experiment. Understanding helium outgassing is important for accurate diagnostics in experiments surrounding nuclear fusion. The presence of helium is often cited as the primary evidence that a nuclear reaction has occurred, so it is imperative that known sources of helium are mitigated prior to proceeding with novel nuclear experiments. It is also necessary to ensure hermiticity when transferring gas aliquots from an experiment to a mass spectrometer. In this article, we present studies of detecting helium leak rates in systems used in novel nuclear experiments. We also present studies of helium retention in materials subjected to various heating profiles and atmospheric concentrations. Without pretreatment, stainless-steel 316 retains between 15 $\unicode{x2013}$ 240 pmol of $^{ 4}$He or an areal outgassing amount of 0.07 $\unicode{x2013}$ 1.20 pmol/$cm^{ 2}$. It also may reabsorb $^{ 4}$He from the atmosphere in time. These studies also demonstrate that it is necessary to pretreat most materials prior to performing experiments where the presence of $^{ 4}$He is being used as an indicator for novel nuclear reactions.


title: Integrating embedded neural networks and self-mixing interferometry for smart sensors design

abstract: Self-mixing interferometry is a measurement approach in which a laser beam is re-injected into the emitting laser itself after reflection on a target. Information about the position of the target can be obtained from monitoring the voltage across the laser. However, analyzing this signal is difficult. In previous works, neural networks have been used with great success to process this data. In this article, we present the first prototype of an integrated sensor based on self-mixing interferometry with embedded neural networks. It consists of a semiconductor laser (acting both as light emitter and detector) equipped with an embedded platform for data processing. The platform includes an ADC (Analog-to-Digital Converter) and an STM32L476RG microcontroller. The microcontroller runs the neural network in charge of reconstructing the displacement of a target from the interferometric signal entering the ADC. We assess the robustness of the neural network to unwanted signal amplitude variations and the impact of different network weights quantization choices required to run the network on the microcontroller. Finally, we provide a demonstration of target displacement reconstruction fully running on the embedded platform. Our results pave the way towards robust, low power and versatile sensors based on self-mixing interferometry and embedded neural networks.


title: YAP:Ce scintillator as an absolute ultracold neutron detector

abstract: The upcoming UCNProBe experiment at Los Alamos National Laboratory will measure the $\beta$-decay rate of free neutrons with different systematic uncertainties than previous beam-based neutron lifetime experiments. We have developed a new $^{10}$B-coated YAP:Ce scintillator whose properties are presented. The advantage of the YAP:Ce scintillator is its high Fermi potential, which reduces the probability for upscattering of ultracold neutrons, and its short decay time, which is important at high counting rates. Birks' coefficient of YAP:Ce was measured to be ($5.56^{+0.05}_{-0.30})\times 10^{-4}$ cm/MeV and light losses due to 120 nm of $^{10}$B-coating to be about 60%. The loss of light from YAP:Ce due to transmission through deuterated polystyrene scintillator was about 50%. The efficiency for counting neutrons that are captured on the $^{10}$B coating is (86.82 $\pm$ 2.61)%. Measurement with ultracold neutrons showed that YAP:Ce crystal counted 8% to 28% more UCNs compared to ZnS screen. This may be due to an uneven coating of $^{10}$B on the rough surface.


title: Simulating the aftermath of Northern European Enclosure Dam (NEED) break and flooding of European coast

abstract: The Northern European Enclosure Dam (NEED) is a hypothetical project to prevent flooding in European countries following the rising ocean level due to melting arctic glaciers. This project involves the construction of two large dams between Scotland and Norway, as well as England and France. The anticipated cost of this project is 250 to 500 billion euros. In this paper, we present the simulation of the aftermath of flooding on the European coastline caused by a catastrophic break of this hypothetical dam. From our simulation results, we can observe that there is a traveling wave after the accident, with a velocity of around 10 kilometers per hour, raising the sea level permanently inside the dammed region. This observation implies a need to construct additional dams or barriers protecting the northern coastline of the Netherlands and the interior of the Baltic Sea. Our simulations have been obtained using the following building blocks. First, a graph transformation model was applied to generate an adaptive mesh approximating the topography of the Earth. We employ the composition graph grammar model for breaking triangular elements in the mesh without the generation of hanging nodes. Second, the wave equation is formulated in a spherical latitude-longitude system of coordinates and solved by a high-order time integration scheme using the generalized $\alpha$ method.


title: Measurement of Low Energy Nuclear Recoil Events with the phonon-mediated Voltage-Assisted Hybrid Detector for Rare Event Searches

abstract: The phonon-mediated hybrid detector is made out of a monolithic silicon crystal characterized by two interconnected regions linked through a narrow neck. Operating solely on phonon signal measurements, the hybrid design facilitates the differentiation between electron recoil and nuclear recoil events, effectively discerning two types of interaction down to low energy levels. With a newly implemented software triggering technique (SWT), low-energy nuclear recoil events of approximately $500~eV_{ee}$ have been measured. In addition to this, an electron recoil background reduction of up to $95\%$ has been successfully demonstrated.


title: YOLOv5 vs. YOLOv8 in Marine Fisheries: Balancing Class Detection and Instance Count

abstract: This paper presents a comparative study of object detection using YOLOv5 and YOLOv8 for three distinct classes: artemia, cyst, and excrement. In this comparative study, we analyze the performance of these models in terms of accuracy, precision, recall, etc. where YOLOv5 often performed better in detecting Artemia and cysts with excellent precision and accuracy. However, when it came to detecting excrement, YOLOv5 faced notable challenges and limitations. This suggests that YOLOv8 offers greater versatility and adaptability in detection tasks while YOLOv5 may struggle in difficult situations and may need further fine-tuning or specialized training to enhance its performance. The results show insights into the suitability of YOLOv5 and YOLOv8 for detecting objects in challenging marine environments, with implications for applications such as ecological research.


title: Physics-informed Data-driven Cavitation Model for a Specific MG EOS

abstract: We present a novel one-fluid cavitation model of a specific Mie-Gr\"uneisen equation of state(EOS), named polynomial EOS, based on an artificial neural network. Not only the physics-informed equation but also the experimental data are embedded into the proposed model by an optimization problem. The physics-informed data-driven model provides the concerned pressure within the cavitation region, where the density tends to zero when the pressure falls below the saturated pressure. The present model is then applied to computing the challenging compressible multi-phase flow simulation, such as nuclear and underwater explosions. Numerical simulations show that our model in application agrees well with the corresponding experimental data, ranging from one dimension to three dimensions with the $h-$adaptive mesh refinement algorithm and load balance techniques in the structured and unstructured grid.


title: A geometric framework for interstellar discourse on fundamental physical structures

abstract: This paper considers the possibility that abstract thinking and advanced synthesis skills might encourage extraterrestrial civilizations to accept communication with mankind on Earth. For this purpose, a notation not relying upon the use of alphabet and numbers is proposed, in order to denote just some basic geometric structures of current physical theories: vector fields, one-form fields, and tensor fields of arbitrary order. An advanced civilization might appreciate the way here proposed to achieve a concise description of electromagnetism and general relativity, and hence it might accept the challenge of responding to our signals. The abstract symbols introduced in this paper to describe the basic structures of physical theories are encoded into black and white bitmap images that can be easily converted into short bit sequences and modulated on a carrier wave for radio transmission.


title: Regime Identification for Improving Causal Analysis in Non-stationary Timeseries

abstract: Time series data from real-world systems often display non-stationary behavior, indicating varying statistical characteristics over time. This inherent variability poses significant challenges in deciphering the underlying structural relationships within the data, particularly in correlation and causality analyses, model stability, etc. Recognizing distinct segments or regimes within multivariate time series data, characterized by relatively stable behavior and consistent statistical properties over extended periods, becomes crucial. In this study, we apply the regime identification (RegID) technique to multivariate time series, fundamentally designed to unveil locally stationary segments within data. The distinguishing features between regimes are identified using covariance matrices in a Riemannian space. We aim to highlight how regime identification contributes to improving the discovery of causal structures from multivariate non-stationary time series data. Our experiments, encompassing both synthetic and real-world datasets, highlight the effectiveness of regime-wise time series causal analysis. We validate our approach by first demonstrating improved causal structure discovery using synthetic data where the ground truth causal relationships are known. Subsequently, we apply this methodology to climate-ecosystem dataset, showcasing its applicability in real-world scenarios.


title: A Cloud-Edge Framework for Energy-Efficient Event-Driven Control: An Integration of Online Supervised Learning, Spiking Neural Networks and Local Plasticity Rules

abstract: This paper presents a novel cloud-edge framework for addressing computational and energy constraints in complex control systems. Our approach centers around a learning-based controller using Spiking Neural Networks (SNN) on physical plants. By integrating a biologically plausible learning method with local plasticity rules, we harness the efficiency, scalability, and low latency of SNNs. This design replicates control signals from a cloud-based controller directly on the plant, reducing the need for constant plant-cloud communication. The plant updates weights only when errors surpass predefined thresholds, ensuring efficiency and robustness in various conditions. Applied to linear workbench systems and satellite rendezvous scenarios, including obstacle avoidance, our architecture dramatically lowers normalized tracking error by 96% with increased network size. The event-driven nature of SNNs minimizes energy consumption, utilizing only about 111 nJ (0.3% of conventional computing requirements). The results demonstrate the system's adjustment to changing work environments and its efficient use of computational and energy resources, with a moderate increase in energy consumption of 27.2% and 37% for static and dynamic obstacles, respectively, compared to non-obstacle scenarios.


title: Long-term Human Participation Assessment In Collaborative Learning Environments Using Dynamic Scene Analysis

abstract: The paper develops datasets and methods to assess student participation in real-life collaborative learning environments. In collaborative learning environments, students are organized into small groups where they are free to interact within their group. Thus, students can move around freely causing issues with strong pose variation, move out and re-enter the camera scene, or face away from the camera. We formulate the problem of assessing student participation into two subproblems: (i) student group detection against strong background interference from other groups, and (ii) dynamic participant tracking within the group. A massive independent testing dataset of 12,518,250 student label instances, of total duration of 21 hours and 22 minutes of real-life videos, is used for evaluating the performance of our proposed method for student group detection. The proposed method of using multiple image representations is shown to perform equally or better than YOLO on all video instances. Over the entire dataset, the proposed method achieved an F1 score of 0.85 compared to 0.80 for YOLO. Following student group detection, the paper presents the development of a dynamic participant tracking system for assessing student group participation through long video sessions. The proposed dynamic participant tracking system is shown to perform exceptionally well, missing a student in just one out of 35 testing videos. In comparison, a state of the art method fails to track students in 14 out of the 35 testing videos. The proposed method achieves 82.3% accuracy on an independent set of long, real-life collaborative videos.


title: NL2FOL: Translating Natural Language to First-Order Logic for Logical Fallacy Detection

abstract: Logical fallacies are common errors in reasoning that undermine the logic of an argument. Automatically detecting logical fallacies has important applications in tracking misinformation and validating claims. In this paper, we design a process to reliably detect logical fallacies by translating natural language to First-order Logic (FOL) step-by-step using Large Language Models (LLMs). We then utilize Satisfiability Modulo Theory (SMT) solvers to reason about the validity of the formula and classify inputs as either a fallacy or valid statement. Our model also provides a novel means of utilizing LLMs to interpret the output of the SMT solver, offering insights into the counter-examples that illustrate why a given sentence is considered a logical fallacy. Our approach is robust, interpretable and does not require training data or fine-tuning. We evaluate our model on a mixed dataset of fallacies and valid sentences. The results demonstrate improved performance compared to end-to-end LLMs, with our classifier achieving an F1-score of 71\% on the Logic dataset. The approach is able to generalize effectively, achieving an F1-score of 73% on the challenge set, LogicClimate, outperforming state-of-the-art models by 21% despite its much smaller size.


title: Bayesian Inference for Estimating Heat Sources through Temperature Assimilation

abstract: This paper introduces a Bayesian inference framework for two-dimensional steady-state heat conduction, focusing on the estimation of unknown distributed heat sources in a thermally-conducting medium with uniform conductivity. The goal is to infer heater locations, strengths, and shapes using temperature assimilation in the Euclidean space, employing a Fourier series to represent each heater's shape. The Markov Chain Monte Carlo (MCMC) method, incorporating the random-walk Metropolis-Hasting algorithm and parallel tempering, is utilized for posterior distribution exploration in both unbounded and wall-bounded domains. Strong correlations between heat strength and heater area prompt caution against simultaneously estimating these two quantities. It is found that multiple solutions arise in cases where the number of temperature sensors is less than the number of unknown states. Moreover, smaller heaters introduce greater uncertainty in estimated strength. The diffusive nature of heat conduction smooths out any deformations in the temperature contours, especially in the presence of multiple heaters positioned near each other, impacting convergence. In wall-bounded domains with Neumann boundary conditions, the inference of heater parameters tends to be more accurate than in unbounded domains.


title: A SER-based Device Selection Mechanism in Multi-bits Quantization Federated Learning

abstract: The quality of wireless communication will directly affect the performance of federated learning (FL), so this paper analyze the influence of wireless communication on FL through symbol error rate (SER). In FL system, non-orthogonal multiple access (NOMA) can be used as the basic communication framework to reduce the communication congestion and interference caused by multiple users, which takes advantage of the superposition characteristics of wireless channels. The Minimum Mean Square Error (MMSE) based serial interference cancellation (SIC) technology is used to recover the gradient of each terminal node one by one at the receiving end. In this paper, the gradient parameters are quantized into multiple bits to retain more gradient information to the maximum extent and to improve the tolerance of transmission errors. On this basis, we designed the SER-based device selection mechanism (SER-DSM) to ensure that the learning performance is not affected by users with bad communication conditions, while accommodating as many users as possible to participate in the learning process, which is inclusive to a certain extent. The experiments show the influence of multi-bit quantization of gradient on FL and the necessity and superiority of the proposed SER-based device selection mechanism.


title: Accelerating Medical Knowledge Discovery through Automated Knowledge Graph Generation and Enrichment

abstract: Knowledge graphs (KGs) serve as powerful tools for organizing and representing structured knowledge. While their utility is widely recognized, challenges persist in their automation and completeness. Despite efforts in automation and the utilization of expert-created ontologies, gaps in connectivity remain prevalent within KGs. In response to these challenges, we propose an innovative approach termed ``Medical Knowledge Graph Automation (M-KGA)". M-KGA leverages user-provided medical concepts and enriches them semantically using BioPortal ontologies, thereby enhancing the completeness of knowledge graphs through the integration of pre-trained embeddings. Our approach introduces two distinct methodologies for uncovering hidden connections within the knowledge graph: a cluster-based approach and a node-based approach. Through rigorous testing involving 100 frequently occurring medical concepts in Electronic Health Records (EHRs), our M-KGA framework demonstrates promising results, indicating its potential to address the limitations of existing knowledge graph automation techniques.


title: Towards Causal Interpretation of Sexual Orientation in Regression Analysis: Applications and Challenges

abstract: This study presents an approach to analyze health disparities in Sexual and Gender Minority (SGM) populations, with a focus on the role of social support levels as an example to allow causal interpretations of regression models. We advocate for precisely defining the exposure variable and incorporating mediators into analyses, to address the limitations of comparing counterfactual outcomes solely between SGM and heterosexual populations. We define sexual orientation into domains (attraction, behavior, and identity), and emphasize a consideration of these elements either separately or together, depending on the research question. We also introduce social support measured before and after the disclosure of sexual orientation to facilitate inference. We illustrate this approach by examining the association between SGM status and depression diagnosis with data from the 2020 and 2021 National Health Interview Survey. We find a direct effect of SGM status on depression (OR: 3.07, 95% CI: 2.64 - 3.58) and no indirect effect through social support (OR: 1.07, 95% CI: 0.87-1.31). Our research emphasizes the necessity of the comprehensive measurement of sexual orientation and a focus on intervenable variables like social support in order to empower SGM communities and address SGM related health inequalities.


title: CNN-Based Equalization for Communications: Achieving Gigabit Throughput with a Flexible FPGA Hardware Architecture

abstract: To satisfy the growing throughput demand of data-intensive applications, the performance of optical communication systems increased dramatically in recent years. With higher throughput, more advanced equalizers are crucial, to compensate for impairments caused by inter-symbol interference (ISI). The latest research shows that artificial neural network (ANN)-based equalizers are promising candidates to replace traditional algorithms for high-throughput communications. On the other hand, not only throughput but also flexibility is a main objective of beyond-5G and 6G communication systems. A platform that is able to satisfy the strict throughput and flexibility requirements of modern communication systems are field programmable gate arrays (FPGAs). Thus, in this work, we present a high-performance FPGA implementation of an ANN-based equalizer, which meets the throughput requirements of modern optical communication systems. Further, our architecture is highly flexible since it includes a variable degree of parallelism (DOP) and therefore can also be applied to low-cost or low-power applications which is demonstrated for a magnetic recording channel. The implementation is based on a cross-layer design approach featuring optimizations from the algorithm down to the hardware architecture, including a detailed quantization analysis. Moreover, we present a framework to reduce the latency of the ANN-based equalizer under given throughput constraints. As a result, the bit error ratio (BER) of our equalizer for the optical fiber channel is around four times lower than that of a conventional one, while the corresponding FPGA implementation achieves a throughput of more than 40 GBd, outperforming a high-performance graphics processing unit (GPU) by three orders of magnitude for a similar batch size.


title: Combined Compromise for Ideal Solution (CoCoFISo): a multi-criteria decision-making based on the CoCoSo method algorithm

abstract: Each decision-making tool should be tested and validated in real case studies to be practical and fit to global problems. The application of multi-criteria decision-making methods (MCDM) is currently a trend to rank alternatives. In the literature, there are several multi-criteria decision-making methods according to their classification. During our experimentation on the Combined Compromise Solution (CoCoSo) method, we encountered its limits for real cases. The authors examined the applicability of the CoCoFISo method (improved version of combined compromise solution), by a real case study in a university campus and compared the obtained results to other MCDMs such as Preference Ranking Organisation Method for Enrichment Evaluations (PROMETHEE), Weighted Sum Method (WSM) and Technique for Order Preference by Similarity to the Ideal Solution (TOPSIS). Our research finding indicates that CoCoSo is an applied method that has been developed to solve complex multi variable assessment problems, while CoCoFISo can improve the shortages observed in CoCoSo and deliver stable outcomes compared to other developed tools. The findings imply that application of CoCoFISo is suggested to decision makers, experts and researchers while they are facing practical challenges and sensitive questions regarding the utilization of a reliable decision-making method. Unlike many prior studies, the current version of CoCoSo is unique, original and is presented for the first time. Its performance was approved using several strategies and examinations.


title: Multiscale Causal Learning

abstract: Biological intelligence is more sample-efficient than artificial intelligence (AI), learning from fewer examples. Here we answer why. Given data, there can be many policies which seem "correct" because they perfectly fit the data. However, only one correct policy could have actually caused the data. Sample-efficiency requires a means of discerning which. Previous work showed sample efficiency is maximised by weak-policy-optimisation (WPO); preferring policies that more weakly constrain what is considered to be correct, given finite resources. Biology's sample-efficiency demonstrates it is better at WPO. To understand how, we formalise the "multiscale-competency-architecture" (MCA) observed in biological systems, as a sequence of nested "agentic-abstraction-layers". We show that WPO at low levels enables synthesis of weaker policies at high. We call this "multiscale-causal-learning", and argue this is how we might construct more scale-able, sample-efficient and reliable AI. Furthermore, a sufficiently weak policy at low levels is a precondition of collective policy at higher levels. The higher level "identity" of the collective is lost if lower levels use an insufficiently weak policy (e.g. cells may become isolated from the collective informational structure and revert to primitive behaviour). This has implications for biology, machine learning, AI-safety, and philosophy.


title: Evaluating LLMs for Hardware Design and Test

abstract: Large Language Models (LLMs) have demonstrated capabilities for producing code in Hardware Description Languages (HDLs). However, most of the focus remains on their abilities to write functional code, not test code. The hardware design process consists of both design and test, and so eschewing validation and verification leaves considerable potential benefit unexplored, given that a design and test framework may allow for progress towards full automation of the digital design pipeline. In this work, we perform one of the first studies exploring how a LLM can both design and test hardware modules from provided specifications. Using a suite of 8 representative benchmarks, we examined the capabilities and limitations of the state-of-the-art conversational LLMs when producing Verilog for functional and verification purposes. We taped out the benchmarks on a Skywater 130nm shuttle and received the functional chip.


title: CausalDisco: Causal discovery using knowledge graph link prediction

abstract: Causal discovery is a process of discovering new causal relations from observational data. Traditional causal discovery methods often suffer from issues related to missing data To address these issues, this paper presents a novel approach called CausalDisco that formulates causal discovery as a knowledge graph completion problem. More specifically, the task of discovering causal relations is mapped to the task of knowledge graph link prediction. CausalDisco supports two types of discovery: causal explanation and causal prediction. The causal relations have weights representing the strength of the causal association between entities in the knowledge graph. An evaluation of this approach uses a benchmark dataset of simulated videos for causal reasoning, CLEVRER-Humans, and compares the performance of multiple knowledge graph embedding algorithms. In addition, two distinct dataset splitting approaches are utilized within the evaluation: (1) random-based split, which is the method typically used to evaluate link prediction algorithms, and (2) Markov-based split, a novel data split technique for evaluating link prediction that utilizes the Markovian property of the causal relation. Results show that using weighted causal relations improves causal discovery over the baseline without weighted relations.


title: Topology of restricted phase space thermodynamics in Kerr-Sen-Ads black holes

abstract: In this study, we investigate the thermodynamic topology of the Kerr-Sen-Ads black hole in restricted phase space. In the restricted phase space, a new parameter, central charge $C$, and its conjugate parameter $\mu$ are introduced, omitting the well-known $PdV$ term in the first law of black hole thermodynamics. We study the local and global topology of the black hole by considering the black hole solution as topological defects in the free energy landscape. We compute the winding number and the total topological number at the thermodynamic defects. For our analysis, we have considered five ensembles of Kerr-Sen-Ads black holes in restricted phase space: fixed $(Q, J, C)$, fixed $(\phi, J, C)$, fixed $(Q,\Omega, C)$, fixed $(Q, J, \mu)$, and fixed $(\phi,\Omega, C)$, where $Q$ is the electric charge, $J$ is the angular momentum, $C$ is the central charge, $\phi$ is the electric potential conjugate to charge, $\Omega$ is the angular frequency conjugate to $J$, and finally, $\mu$ is the chemical potential. In the fixed $(Q, J, C)$, fixed $(\phi, J, C)$, and fixed $(Q, J, \mu)$ ensembles, we find a topological charge of $+1$. In the fixed $(Q,\Omega, C)$ and fixed $(\phi, \Omega, C)$ ensembles, depending on the values of the thermodynamic parameters, we find topological charges of $-1$, $0$, and $+1$. Interestingly, in ensembles where we find the topological charge to be $0$, we observe both Hawking-Page and Davies type phase transitions. We show that both types of these phase transitions can be studied using a common vector field, and the topological charges associated with Davies type and Hawking-Page phase transitions are $-1$ and $+1$, respectively.


title: Digital ASIC Design with Ongoing LLMs: Strategies and Prospects

abstract: The escalating complexity of modern digital systems has imposed significant challenges on integrated circuit (IC) design, necessitating tools that can simplify the IC design flow. The advent of Large Language Models (LLMs) has been seen as a promising development, with the potential to automate the generation of Hardware Description Language (HDL) code, thereby streamlining digital IC design. However, the practical application of LLMs in this area faces substantial hurdles. Notably, current LLMs often generate HDL code with small but critical syntax errors and struggle to accurately convey the high-level semantics of circuit designs. These issues significantly undermine the utility of LLMs for IC design, leading to misinterpretations and inefficiencies. In response to these challenges, this paper presents targeted strategies to harness the capabilities of LLMs for digital ASIC design. We outline approaches that improve the reliability and accuracy of HDL code generation by LLMs. As a practical demonstration of these strategies, we detail the development of a simple three-phase Pulse Width Modulation (PWM) generator. This project, part of the "Efabless AI-Generated Open-Source Chip Design Challenge," successfully passed the Design Rule Check (DRC) and was fabricated, showcasing the potential of LLMs to enhance digital ASIC design. This work underscores the feasibility and benefits of integrating LLMs into the IC design process, offering a novel approach to overcoming the complexities of modern digital systems.


title: Adaptive Semantic Token Selection for AI-native Goal-oriented Communications

abstract: In this paper, we propose a novel design for AI-native goal-oriented communications, exploiting transformer neural networks under dynamic inference constraints on bandwidth and computation. Transformers have become the standard architecture for pretraining large-scale vision and text models, and preliminary results have shown promising performance also in deep joint source-channel coding (JSCC). Here, we consider a dynamic model where communication happens over a channel with variable latency and bandwidth constraints. Leveraging recent works on conditional computation, we exploit the structure of the transformer blocks and the multihead attention operator to design a trainable semantic token selection mechanism that learns to select relevant tokens (e.g., image patches) from the input signal. This is done dynamically, on a per-input basis, with a rate that can be chosen as an additional input by the user. We show that our model improves over state-of-the-art token selection mechanisms, exhibiting high accuracy for a wide range of latency and bandwidth constraints, without the need for deploying multiple architectures tailored to each constraint. Last, but not least, the proposed token selection mechanism helps extract powerful semantics that are easy to understand and explain, paving the way for interpretable-by-design models for the next generation of AI-native communication systems.


title: Comparing varieties generated by certain wreath products of groups

abstract: An exhaustive version of the thesis to a talk presented at the Groups \& Algebras in Bicocca Conference (GABY), University of Milano-Bicocca (Milan, Italy), June 17 to June 21, 2024.


title: Efficient Exploration of Image Classifier Failures with Bayesian Optimization and Text-to-Image Models

abstract: Image classifiers should be used with caution in the real world. Performance evaluated on a validation set may not reflect performance in the real world. In particular, classifiers may perform well for conditions that are frequently encountered during training, but poorly for other infrequent conditions. In this study, we hypothesize that recent advances in text-to-image generative models make them valuable for benchmarking computer vision models such as image classifiers: they can generate images conditioned by textual prompts that cause classifier failures, allowing failure conditions to be described with textual attributes. However, their generation cost becomes an issue when a large number of synthetic images need to be generated, which is the case when many different attribute combinations need to be tested. We propose an image classifier benchmarking method as an iterative process that alternates image generation, classifier evaluation, and attribute selection. This method efficiently explores the attributes that ultimately lead to poor behavior detection.


title: Speech Technology Services for Oral History Research

abstract: Oral history is about oral sources of witnesses and commentors on historical events. Speech technology is an important instrument to process such recordings in order to obtain transcription and further enhancements to structure the oral account In this contribution we address the transcription portal and the webservices associated with speech processing at BAS, speech solutions developed at LINDAT, how to do it yourself with Whisper, remaining challenges, and future developments.


title: Rad4XCNN: a new agnostic method for post-hoc global explanation of CNN-derived features by means of radiomics

abstract: In the last years, artificial intelligence (AI) in clinical decision support systems (CDSS) played a key role in harnessing machine learning and deep learning architectures. Despite their promising capabilities, the lack of transparency and explainability of AI models poses significant challenges, particularly in medical contexts where reliability is a mandatory aspect. Achieving transparency without compromising predictive accuracy remains a key challenge. This paper presents a novel method, namely Rad4XCNN, to enhance the predictive power of CNN-derived features with the interpretability inherent in radiomic features. Rad4XCNN diverges from conventional methods based on saliency map, by associating intelligible meaning to CNN-derived features by means of Radiomics, offering new perspectives on explanation methods beyond visualization maps. Using a breast cancer classification task as a case study, we evaluated Rad4XCNN on ultrasound imaging datasets, including an online dataset and two in-house datasets for internal and external validation. Some key results are: i) CNN-derived features guarantee more robust accuracy when compared against ViT-derived and radiomic features; ii) conventional visualization map methods for explanation present several pitfalls; iii) Rad4XCNN does not sacrifice model accuracy for their explainability; iv) Rad4XCNN provides global explanation insights enabling the physician to analyze the model outputs and findings. In addition, we highlight the importance of integrating interpretability into AI models for enhanced trust and adoption in clinical practice, emphasizing how our method can mitigate some concerns related to explainable AI methods.


title: sDAC -- Semantic Digital Analog Converter for Semantic Communications

abstract: In this paper, we propose a novel semantic digital analog converter (sDAC) for the compatibility of semantic communications and digital communications. Most of the current semantic communication systems are based on the analog modulations, ignoring their incorporation with digital communication systems, which are more common in practice. In fact, quantization methods in traditional communication systems are not appropriate for use in the era of semantic communication as these methods do not consider the semantic information inside symbols. In this case, any bit flip caused by channel noise can lead to a great performance drop. To address this challenge, sDAC is proposed. It is a simple yet efficient and generative module used to realize digital and analog bi-directional conversion. On the transmitter side, continuous values from the encoder are converted to binary bits and then can be modulated by any existing methods. After transmitting through the noisy channel, these bits get demodulated by paired methods and converted back to continuous values for further semantic decoding. The whole progress does not depend on any specific semantic model, modulation methods, or channel conditions. In the experiment section, the performance of sDAC is tested across different semantic models, semantic tasks, modulation methods, channel conditions and quantization orders. Test results show that the proposed sDAC has great generative properties and channel robustness.


title: Artificial General Intelligence (AGI)-Native Wireless Systems: A Journey Beyond 6G

abstract: Building future wireless systems that support services like digital twins (DTs) is challenging to achieve through advances to conventional technologies like meta-surfaces. While artificial intelligence (AI)-native networks promise to overcome some limitations of wireless technologies, developments still rely on AI tools like neural networks. Such tools struggle to cope with the non-trivial challenges of the network environment and the growing demands of emerging use cases. In this paper, we revisit the concept of AI-native wireless systems, equipping them with the common sense necessary to transform them into artificial general intelligence (AGI)-native systems. These systems acquire common sense by exploiting different cognitive abilities such as perception, analogy, and reasoning, that enable them to generalize and deal with unforeseen scenarios. Towards developing the components of such a system, we start by showing how the perception module can be built through abstracting real-world elements into generalizable representations. These representations are then used to create a world model, founded on principles of causality and hyper-dimensional (HD) computing, that aligns with intuitive physics and enables analogical reasoning, that define common sense. Then, we explain how methods such as integrated information theory play a role in the proposed intent-driven and objective-driven planning methods that maneuver the AGI-native network to take actions. Next, we discuss how an AGI-native network can enable use cases related to human and autonomous agents: a) analogical reasoning for next-generation DTs, b) synchronized and resilient experiences for cognitive avatars, and c) brain-level metaverse experiences like holographic teleportation. Finally, we conclude with a set of recommendations to build AGI-native systems. Ultimately, we envision this paper as a roadmap for the beyond 6G era.


title: Design Fiction as Breaching Experiment: An Interdisciplinary Methodology for Understanding the Acceptability and Adoption of Future Technologies

abstract: HCI is fundamentally occupied with the problem of the future and understanding the acceptability and adoption challenges that future and emerging technologies face from the viewpoint of their being situated in everyday life. This paper explicates an interdisciplinary approach towards addressing the problem and understanding acceptability and adoption challenges that leverages design fiction as breaching experiment. Design fiction is an arts based approach to exploring the future, breaching experiments a social science method for explicating common sense reasoning and surfacing the taken for granted expectations societys members have and hold about situated action and how it should work. Both approaches have previously been employed in HCI, but this the first time they have been combined to enable HCI researchers to provoke through design the acceptability and adoption challenges that confront future and emerging technologies.


title: Mixed or Misperceived Reality?

abstract: "Surrealism Me" delves into Vil\'em Flusser's critique of media as mediators that often distort human perception of reality through an interactive virtual-embodying MR experience. It examines the obfuscating nature of media and reveals the constructed nature of media-projected realities, prompting a reevaluation of media's role and influence on our perception.


title: Noise Models in the LISA Mission

abstract: This document briefly describes the noise models and shapes used for the synthesis of the Drag-Free and Attitude Control System in the LISA space mission. LISA (Laser Interferometer Space Antenna) is one of the next large-class missions from the European Space Agency (ESA), expected to be launched in 2034. The main goal of the mission is to detect the gravitational waves, which are undulatory perturbations of the space-time fabric, extremely important to collect experimental proofs for the General Relativity Theory. In the 90s, different international collaborations of institutes laid the foundations for the first ground-based interferometers (see, e.g., LIGO and Virgo). However, ground-based interferometers have a limited bandwidth due to the Earth's environmental noises and short arm-length of few kilometers. Therefore, they cannot observe gravitational waves belonging to the portion of the spectrum below 1 Hz. This issue can be overcome by means of space-based interferometers, that can have arm-lengths up to millions of kilometers and exploit a quieter environment than the Earth's surface. The LISA system is affected by actuation, sensing and environmental disturbances and noises. Among the actuation noises we have those given by the Micro Propulsion System (MPS), the Gravitational Reference Sensor (GRS) and the Optical Assembly (OA) motor. Among the sensing noises we consider the interferometer, the Differential Wavefront Sensor (DWS) and the GRS. The environmental disturbances are given by the solar radiation pressure, the test-mass stiffness and self-gravity, and the environmental noises acting directly on the test-mass.


title: A Comprehensive Approach to Carbon Dioxide Emission Analysis in High Human Development Index Countries using Statistical and Machine Learning Techniques

abstract: Reducing Carbon dioxide (CO2) emission is vital at both global and national levels, given their significant role in exacerbating climate change. CO2 emission, stemming from a variety of industrial and economic activities, are major contributors to the greenhouse effect and global warming, posing substantial obstacles in addressing climate issues. It's imperative to forecast CO2 emission trends and classify countries based on their emission patterns to effectively mitigate worldwide carbon emission. This paper presents an in-depth comparative study on the determinants of CO2 emission in twenty countries with high Human Development Index (HDI), exploring factors related to economy, environment, energy use, and renewable resources over a span of 25 years. The study unfolds in two distinct phases: initially, statistical techniques such as Ordinary Least Squares (OLS), fixed effects, and random effects models are applied to pinpoint significant determinants of CO2 emission. Following this, the study leverages supervised and unsupervised machine learning (ML) methods to further scrutinize and understand the factors influencing CO2 emission. Seasonal AutoRegressive Integrated Moving Average with eXogenous variables (SARIMAX), a supervised ML model, is first used to predict emission trends from historical data, offering practical insights for policy formulation. Subsequently, Dynamic Time Warping (DTW), an unsupervised learning approach, is used to group countries by similar emission patterns. The dual-phase approach utilized in this study significantly improves the accuracy of CO2 emission predictions while also providing a deeper insight into global emission trends. By adopting this thorough analytical framework, nations can develop more focused and effective carbon reduction policies, playing a vital role in the global initiative to combat climate change.


title: Improved Communication-Privacy Trade-offs in $L_2$ Mean Estimation under Streaming Differential Privacy

abstract: We study $L_2$ mean estimation under central differential privacy and communication constraints, and address two key challenges: firstly, existing mean estimation schemes that simultaneously handle both constraints are usually optimized for $L_\infty$ geometry and rely on random rotation or Kashin's representation to adapt to $L_2$ geometry, resulting in suboptimal leading constants in mean square errors (MSEs); secondly, schemes achieving order-optimal communication-privacy trade-offs do not extend seamlessly to streaming differential privacy (DP) settings (e.g., tree aggregation or matrix factorization), rendering them incompatible with DP-FTRL type optimizers. In this work, we tackle these issues by introducing a novel privacy accounting method for the sparsified Gaussian mechanism that incorporates the randomness inherent in sparsification into the DP noise. Unlike previous approaches, our accounting algorithm directly operates in $L_2$ geometry, yielding MSEs that fast converge to those of the uncompressed Gaussian mechanism. Additionally, we extend the sparsification scheme to the matrix factorization framework under streaming DP and provide a precise accountant tailored for DP-FTRL type optimizers. Empirically, our method demonstrates at least a 100x improvement of compression for DP-SGD across various FL tasks.