title: Investigating the Use of Traveltime and Reflection Tomography for Deep Learning-Based Sound-Speed Estimation in Ultrasound Computed Tomography

abstract: Ultrasound computed tomography (USCT) is actively being developed to quantify acoustic tissue properties such as the speed-of-sound (SOS). Although full-waveform inversion (FWI) is an effective method for accurate SOS reconstruction, it can be computationally challenging for large-scale problems. Deep learning-based image-to-image learned reconstruction (IILR) methods are being investigated as scalable and computationally efficient alternatives. This study investigates the impact of the chosen input modalities on IILR methods for high-resolution SOS reconstruction in USCT. The selected modalities are traveltime tomography (TT) and reflection tomography (RT), which produce a low-resolution SOS map and a reflectivity map, respectively. These modalities have been chosen for their lower computational cost relative to FWI and their capacity to provide complementary information: TT offers a direct -- while low resolution -- SOS measure, while RT reveals tissue boundary information. Systematic analyses were facilitated by employing a stylized USCT imaging system with anatomically realistic numerical breast phantoms. Within this testbed, a supervised convolutional neural network (CNN) was trained to map dual-channel (TT and RT images) to a high-resolution SOS map. Moreover, the CNN was fine-tuned using a weighted reconstruction loss that prioritized tumor regions to address tumor underrepresentation in the training dataset. To understand the benefits of employing dual-channel inputs, single-input CNNs were trained separately using inputs from each modality alone (TT or RT). The methods were assessed quantitatively using normalized root mean squared error and structural similarity index measure for reconstruction accuracy and receiver operating characteristic analysis to assess signal detection-based performance measures.


title: Consensus-based Resource Scheduling for Collaborative Multi-Robot Tasks

abstract: We propose integrating the edge-computing paradigm into the multi-robot collaborative scheduling to maximize resource utilization for complex collaborative tasks, which many robots must perform together. Examples include collaborative map-merging to produce a live global map during exploration instead of traditional approaches that schedule tasks on centralized cloud-based systems to facilitate computing. Our decentralized approach to a consensus-based scheduling strategy benefits a multi-robot-edge collaboration system by adapting to dynamic computation needs and communication-changing statistics as the system tries to optimize resources while maintaining overall performance objectives. Before collaborative task offloading, continuous device, and network profiling are performed at the computing resources, and the distributed scheduling scheme then selects the resource with maximum utility derived using a utility maximization approach. Thorough evaluations with and without edge servers on simulation and real-world multi-robot systems demonstrate that a lower task latency, a large throughput gain, and better frame rate processing may be achieved compared to the conventional edge-based systems.


title: Minutes-duration Optical Flares with Supernova Luminosities

abstract: In recent years, certain luminous extragalactic optical transients have been observed to last only a few days. Their short observed duration implies a different powering mechanism from the most common luminous extragalactic transients (supernovae) whose timescale is weeks. Some short-duration transients, most notably AT2018cow, display blue optical colours and bright radio and X-ray emission. Several AT2018cow-like transients have shown hints of a long-lived embedded energy source, such as X-ray variability, prolonged ultraviolet emission, a tentative X-ray quasiperiodic oscillation, and large energies coupled to fast (but subrelativistic) radio-emitting ejecta. Here we report observations of minutes-duration optical flares in the aftermath of an AT2018cow-like transient, AT2022tsd (the "Tasmanian Devil"). The flares occur over a period of months, are highly energetic, and are likely nonthermal, implying that they arise from a near-relativistic outflow or jet. Our observations confirm that in some AT2018cow-like transients the embedded energy source is a compact object, either a magnetar or an accreting black hole.


title: Utility AI for Dynamic Task Offloading in the Multi-Edge Infrastructure

abstract: To circumvent persistent connectivity to the cloud infrastructure, the current emphasis on computing at network edge devices in the multi-robot domain is a promising enabler for delay-sensitive jobs, yet its adoption is rife with challenges. This paper proposes a novel utility-aware dynamic task offloading strategy based on a multi-edge-robot system that takes into account computation, communication, and task execution load to minimize the overall service time for delay-sensitive applications. Prior to task offloading, continuous device, network, and task profiling are performed, and for each task assigned, an edge with maximum utility is derived using a weighted utility maximization technique, and a system reward assignment for task connectivity or sensitivity is performed. A scheduler is in charge of task assignment, whereas an executor is responsible for task offloading on edge devices. Experimental comparisons of the proposed approach with conventional offloading methods indicate better performance in terms of optimizing resource utilization and minimizing task latency.


title: You Cannot Escape Me: Detecting Evasions of SIEM Rules in Enterprise Networks

abstract: Cyberattacks have grown into a major risk for organizations, with common consequences being data theft, sabotage, and extortion. Since preventive measures do not suffice to repel attacks, timely detection of successful intruders is crucial to stop them from reaching their final goals. For this purpose, many organizations utilize Security Information and Event Management (SIEM) systems to centrally collect security-related events and scan them for attack indicators using expert-written detection rules. However, as we show by analyzing a set of widespread SIEM detection rules, adversaries can evade almost half of them easily, allowing them to perform common malicious actions within an enterprise network without being detected. To remedy these critical detection blind spots, we propose the idea of adaptive misuse detection, which utilizes machine learning to compare incoming events to SIEM rules on the one hand and known-benign events on the other hand to discover successful evasions. Based on this idea, we present AMIDES, an open-source proof-of-concept adaptive misuse detection system. Using four weeks of SIEM events from a large enterprise network and more than 500 hand-crafted evasions, we show that AMIDES successfully detects a majority of these evasions without any false alerts. In addition, AMIDES eases alert analysis by assessing which rules were evaded. Its computational efficiency qualifies AMIDES for real-world operation and hence enables organizations to significantly reduce detection blind spots with moderate effort.


title: Multifractal fluctuations of the precipitation in Spain (1960-2019)

abstract: In this work, an analysis of multifractal parameters of daily precipitation series over the Iberian Peninsula was performed in two 30-year periods to explore whether these properties follow any pattern. Fluctuations of precipitation series show three different scaling regions. Only two distinct regimes for small and large timescales can be confirmed, while intermediate scales are part of a transition region. It is also observed a certain degree of multifractality, which is higher for small timescales. At these scales, there is a high persistence which follows the spatial gradient of the annual precipitation. Moreover, multifractal parameters of the precipitation are modified according to complex spatial and temporal patterns. Only persistence uniformly decreases in the last period. Other relevant findings are the changes in the asymmetry of multifractal spectra in the eastern belt at larger timescales, which might be related to the change in the behavior of the Mediterranean cyclones.


title: Generative AI in Undergraduate Information Technology Education -- Insights from nine courses

abstract: The increasing use of digital teaching and emerging technologies, particularly AI-based tools, such as ChatGPT, is presenting an inevitable and significant impact on higher education. The capability of processing and generating text could bring change to several areas, such as learning assessments or learning experiences. Besides the negative impact, i.e exam cheating, we also see a positive side that ChatGPT can bring to education. This research article aims to contribute to the current debate on ChatGPT by systematic reflection and experience reported from nine bachelor IT courses at a Norwegian university. We conducted inductive empirical research with reflective notes and focused groups of lecturers from nine different IT courses. The findings were thematically organized with numerous use cases in teaching IT subjects. Our discussion highlights the disruptive implications of AI assistant usage in higher education and emphasizes the need for educators to shape this transformation.


title: CORNN: Convex optimization of recurrent neural networks for rapid inference of neural dynamics

abstract: Advances in optical and electrophysiological recording technologies have made it possible to record the dynamics of thousands of neurons, opening up new possibilities for interpreting and controlling large neural populations in behaving animals. A promising way to extract computational principles from these large datasets is to train data-constrained recurrent neural networks (dRNNs). Performing this training in real-time could open doors for research techniques and medical applications to model and control interventions at single-cell resolution and drive desired forms of animal behavior. However, existing training algorithms for dRNNs are inefficient and have limited scalability, making it a challenge to analyze large neural recordings even in offline scenarios. To address these issues, we introduce a training method termed Convex Optimization of Recurrent Neural Networks (CORNN). In studies of simulated recordings, CORNN attained training speeds ~100-fold faster than traditional optimization approaches while maintaining or enhancing modeling accuracy. We further validated CORNN on simulations with thousands of cells that performed simple computations such as those of a 3-bit flip-flop or the execution of a timed response. Finally, we showed that CORNN can robustly reproduce network dynamics and underlying attractor structures despite mismatches between generator and inference models, severe subsampling of observed neurons, or mismatches in neural time-scales. Overall, by training dRNNs with millions of parameters in subminute processing times on a standard computer, CORNN constitutes a first step towards real-time network reproduction constrained on large-scale neural recordings and a powerful computational tool for advancing the understanding of neural computation.


title: Fused Breadth-First Probabilistic Traversals on Distributed GPU Systems

abstract: Probabilistic breadth-first traversals (BPTs) are used in many network science and graph machine learning applications. In this paper, we are motivated by the application of BPTs in stochastic diffusion-based graph problems such as influence maximization. These applications heavily rely on BPTs to implement a Monte-Carlo sampling step for their approximations. Given the large sampling complexity, stochasticity of the diffusion process, and the inherent irregularity in real-world graph topologies, efficiently parallelizing these BPTs remains significantly challenging. In this paper, we present a new algorithm to fuse massive number of concurrently executing BPTs with random starts on the input graph. Our algorithm is designed to fuse BPTs by combining separate traversals into a unified frontier on distributed multi-GPU systems. To show the general applicability of the fused BPT technique, we have incorporated it into two state-of-the-art influence maximization parallel implementations (gIM and Ripples). Our experiments on up to 4K nodes of the OLCF Frontier supercomputer ($32,768$ GPUs and $196$K CPU cores) show strong scaling behavior, and that fused BPTs can improve the performance of these implementations up to 34$\times$ (for gIM) and ~360$\times$ (for Ripples).


title: Confinement of the Solar Tachocline by a Non-Axisymmetric Dynamo

abstract: We recently presented the first 3D numerical simulation of the solar interior for which tachocline confinement was achieved by a dynamo-generated magnetic field. In this followup study, we analyze the degree of confinement as the magnetic field strength changes (controlled by varying the magnetic Prandtl number) in a coupled radiative zone (RZ) and convection zone (CZ) system. We broadly find three solution regimes, corresponding to weak, medium, and strong dynamo magnetic field strengths. In the weak-field regime, the large-scale magnetic field is mostly axisymmetric with regular, periodic polarity reversals (reminiscent of the observed solar cycle), but fails to create a confined tachocline. In the strong-field regime, the large-scale field is mostly non-axisymmetric with irregular, quasi-periodic polarity reversals, and creates a confined tachocline. In the medium-field regime, the large-scale field resembles a strong-field dynamo for extended intervals, but intermittently weakens to allow temporary epochs of strong differential rotation. In all regimes, the amplitude of poloidal field strength in the RZ is very well explained by skin-depth arguments, wherein the oscillating field that gives rise to the skin depth (in the medium- and strong-field cases) is a non-axisymmetric field structure rotating with respect to the RZ. These new simulations reaffirm that tachocline confinement by the solar dynamo (the so-called fast magnetic confinement scenario) is possible, but suggest a new picture in which non-axisymmetric field components rotating with respect to the RZ play the primary role, instead of the regularly reversing axisymmetic field associated with the 22-year cycle.


title: Adaptive Optimization Algorithms for Machine Learning

abstract: Machine learning assumes a pivotal role in our data-driven world. The increasing scale of models and datasets necessitates quick and reliable algorithms for model training. This dissertation investigates adaptivity in machine learning optimizers. The ensuing chapters are dedicated to various facets of adaptivity, including: 1. personalization and user-specific models via personalized loss, 2. provable post-training model adaptations via meta-learning, 3. learning unknown hyperparameters in real time via hyperparameter variance reduction, 4. fast O(1/k^2) global convergence of second-order methods via stepsized Newton method regardless of the initialization and choice basis, 5. fast and scalable second-order methods via low-dimensional updates. This thesis contributes novel insights, introduces new algorithms with improved convergence guarantees, and improves analyses of popular practical algorithms.


title: The NFA Acceptance Hypothesis: Non-Combinatorial and Dynamic Lower Bounds

abstract: We pose the fine-grained hardness hypothesis that the textbook algorithm for the NFA Acceptance problem is optimal up to subpolynomial factors, even for dense NFAs and fixed alphabets. We show that this barrier appears in many variations throughout the algorithmic literature by introducing a framework of Colored Walk problems. These yield fine-grained equivalent formulations of the NFA Acceptance problem as problems concerning detection of an $s$-$t$-walk with a prescribed color sequence in a given edge- or node-colored graph. For NFA Acceptance on sparse NFAs (or equivalently, Colored Walk in sparse graphs), a tight lower bound under the Strong Exponential Time Hypothesis has been rediscovered several times in recent years. We show that our hardness hypothesis, which concerns dense NFAs, has several interesting implications: - It gives a tight lower bound for Context-Free Language Reachability. This proves conditional optimality for the class of 2NPDA-complete problems, explaining the cubic bottleneck of interprocedural program analysis. - It gives a tight $(n+nm^{1/3})^{1-o(1)}$ lower bound for the Word Break problem on strings of length $n$ and dictionaries of total size $m$. - It implies the popular OMv hypothesis. Since the NFA acceptance problem is a static (i.e., non-dynamic) problem, this provides a static reason for the hardness of many dynamic problems. Thus, a proof of the NFA Acceptance hypothesis would resolve several interesting barriers. Conversely, a refutation of the NFA Acceptance hypothesis may lead the way to attacking the current barriers observed for Context-Free Language Reachability, the Word Break problem and the growing list of dynamic problems proven hard under the OMv hypothesis.


title: A case study of multi-modal, multi-institutional data management for the combinatorial materials science community

abstract: Although the convergence of high-performance computing, automation, and machine learning has significantly altered the materials design timeline, transformative advances in functional materials and acceleration of their design will require addressing the deficiencies that currently exist in materials informatics, particularly a lack of standardized experimental data management. The challenges associated with experimental data management are especially true for combinatorial materials science, where advancements in automation of experimental workflows have produced datasets that are often too large and too complex for human reasoning. The data management challenge is further compounded by the multi-modal and multi-institutional nature of these datasets, as they tend to be distributed across multiple institutions and can vary substantially in format, size, and content. To adequately map a materials design space from such datasets, an ideal materials data infrastructure would contain data and metadata describing i) synthesis and processing conditions, ii) characterization results, and iii) property and performance measurements. Here, we present a case study for the low-barrier development of such a dashboard that enables standardized organization, analysis, and visualization of a large data lake consisting of combinatorial datasets of synthesis and processing conditions, X-ray diffraction patterns, and materials property measurements generated at several different institutions. While this dashboard was developed specifically for data-driven thermoelectric materials discovery, we envision the adaptation of this prototype to other materials applications, and, more ambitiously, future integration into an all-encompassing materials data management infrastructure.


title: Bayes in the age of intelligent machines

abstract: The success of methods based on artificial neural networks in creating intelligent machines seems like it might pose a challenge to explanations of human cognition in terms of Bayesian inference. We argue that this is not the case, and that in fact these systems offer new opportunities for Bayesian modeling. Specifically, we argue that Bayesian models of cognition and artificial neural networks lie at different levels of analysis and are complementary modeling approaches, together offering a way to understand human cognition that spans these levels. We also argue that the same perspective can be applied to intelligent machines, where a Bayesian approach may be uniquely valuable in understanding the behavior of large, opaque artificial neural networks that are trained on proprietary data.


title: Stella Nera: Achieving 161 TOp/s/W with Multiplier-free DNN Acceleration based on Approximate Matrix Multiplication

abstract: From classical HPC to deep learning, MatMul is at the heart of today's computing. The recent Maddness method approximates MatMul without the need for multiplication by using a hash-based version of product quantization (PQ) indexing into a look-up table (LUT). Stella Nera is the first Maddness accelerator and it achieves 15x higher area efficiency (GMAC/s/mm^2) and more than 25x higher energy efficiency (TMAC/s/W) than direct MatMul accelerators implemented in the same technology. The hash function is a decision tree, which allows for an efficient hardware implementation as the multiply-accumulate operations are replaced by decision tree passes and LUT lookups. The entire Maddness MatMul can be broken down into parts that allow an effective implementation with small computing units and memories, allowing it to reach extreme efficiency while remaining generically applicable for MatMul tasks. In a commercial 14nm technology and scaled to 3nm, we achieve an energy efficiency of 161 TOp/s/W@0.55V with a Top-1 accuracy on CIFAR-10 of more than 92.5% using ResNet9.


title: A geometric approach to apriori estimates for optimal transport maps

abstract: A key inequality which underpins the regularity theory of optimal transport for costs satisfying the Ma--Trudinger--Wang condition is the Pogorelov second derivative bound. This translates to an apriori interior $C^1$ estimate for smooth optimal maps. Here we give a new derivation of this estimate which relies in part on Kim, McCann and Warren's observation that the graph of an optimal map becomes a volume maximizing spacelike submanifold when the product of the source and target domains is endowed with a suitable pseudo-Riemannian geometry that combines both the marginal densities and the cost.


title: Cardinal invariants of a meager ideal

abstract: Let $\mathcal M_X$ denote the ideal of meager subsets of a topological space $X$. We prove that if $X$ is a completely metrizable space without isolated points, then the smallest cardinality of a non-meager subset of $X$, denoted $\mathrm{non}(\mathcal M_X)$, is exactly $\mathrm{non}(\mathcal M_X) = \mathrm{cf}[\kappa]^\omega \cdot \mathrm{non}(\mathcal M_{\mathbb R})$, where $\kappa$ is the minimum weight of a nonempty open subset of $X$. We also characterize the additivity and covering numbers for $\mathcal M_X$ in terms of simple topological properties of $X$. Some bounds are proved and some questions raised concerning the cofinality of $\mathcal M_X$ and the cofinality of the related ideal of nowhere dense subsets of $X$. We also show that if $X$ is a compact Hausdorff space with $\pi$-weight $\kappa$, then $\mathrm{non}(\mathcal M_X) \leq \mathrm{cf}[\kappa]^\omega \cdot \mathrm{non}(\mathcal M_{\mathbb R})$. This bound for compact Hausdorff spaces is not sharp, in the sense that it is consistent for such a space to have non-meager subsets of even smaller cardinality.


title: Deriving Weeklong Activity-Travel Dairy from Google Location History: Survey Tool Development and A Field Test in Toronto

abstract: This paper introduces an innovative travel survey methodology that utilizes Google Location History (GLH) data to generate travel diaries for transportation demand analysis. By leveraging the accuracy and omnipresence among smartphone users of GLH, the proposed methodology avoids the need for proprietary GPS tracking applications to collect smartphone-based GPS data. This research enhanced an existing travel survey designer, Travel Activity Internet Survey Interface (TRAISI), to make it capable of deriving travel diaries from the respondents' GLH. The feasibility of this data collection approach is showcased through the Google Timeline Travel Survey (GTTS) conducted in the Greater Toronto Area, Canada. The resultant dataset from the GTTS is demographically representative and offers detailed and accurate travel behavioural insights.


title: High-order Harmonic Generation in Thermotropic Liquid Crystals

abstract: Thermotropic liquid crystals are versatile optical materials that exhibit a state of matter intermediate between liquids and solids. Their properties can change significantly with temperature, pressure, or other external factors, leading to different phases. The transport properties within these materials in different phases are still largely unexplored and their understanding would enable exciting prospects for innovative technological advancements. High-order harmonic spectroscopy proved to be a powerful spectroscopic tool for investigating the electronic and nuclear dynamics in matter. Here we report the first experimental observation of high-order harmonic generation in thermotropic liquid crystals in two different phase states, nematic and isotropic. We found the harmonic emission in the nematic phase to be strongly dependent on the relative orientation of the driving field polarization with respect to the liquid crystal alignment. Specifically, the harmonic yield has a maximum when the molecules are aligned perpendicularly to the polarization of the incoming radiation. Our results establish the first step for applying high-order harmonic spectroscopy as a tool for resolving ultrafast electron dynamics in liquid crystals with unprecedented temporal and spatial resolution.


title: Completion of a period map of Hodge type (1,2,2,1)

abstract: We give a completion of the period map associated to a variation of polarized Hodge structure arising from a 2-dimensional geometric family that has Hodge type (1,2,2,1). This is the second known example of a completion of a period map that is higher than one dimensional with non-hermitian symmetric Mumford-Tate domain. The completion technique we use is the theory of Kato-Usui spaces, while the calculation of monodromy matrices is done with the help of mirror symmetry.


title: Permutation invariance, partition algebras and large $N$ matrix models

abstract: In this thesis we will study matrix models with discrete gauge group $S_N$. We will put these matrix models into a generalized Schur-Weyl duality framework where dual algebras, known as partition algebras, emerge. These form generalizations of the symmetric group algebras -- they are semi-simple finite-dimensional associative algebras with a basis labelled by diagrams. We review the structure and representation theory of partition algebras. These algebras are then used to compute expectation values of $S_N$ invariant observables. This is a step towards studying the emergence of new geometric structures in their Feynman diagram expansion. Matrix models also appear in the form of quantum mechanical models of matrix oscillators. We explore the implications of the Schur-Weyl duality framework to matrix quantum mechanics with permutation symmetry.


title: Brillouin laser-driven terahertz oscillator up to 3 THz with femtosecond-level timing jitter

abstract: The terahertz (THz) frequency range, spanning 0.1 to 10 THz, is a field ripe for innovation with vast, developing potential in areas like wireless communication and molecular spectroscopy. Our work introduces a dual-wavelength laser design that utilizes stimulated Brillouin scattering in an optical fiber cavity to effectively generate two highly coherent optical Stokes waves with differential phase noise inherently mitigated. To guarantee robust operation, the Stokes waves are optically injected into their respective pump lasers, which also serves to greatly improve the resulting coherence. The frequency difference between the two wavelengths is converted into THz waves through a uni-traveling-carrier photodiode. This innovative design facilitates the generation of THz waves with phase noise levels of less than -100 dBc/Hz, translating to timing noise below 10~$\mathrm{as} / \sqrt{\mathrm{Hz}}$ at 10 kHz Fourier frequency, over a carrier frequency range from 300 GHz to 3 THz. This development in phase noise reduction establishes a new benchmark in the spectral purity of tunable THz sources. Such advances are pivotal for applications to move beyond oscillator constraints.


title: Predictive Minds: LLMs As Atypical Active Inference Agents

abstract: Large language models (LLMs) like GPT are often conceptualized as passive predictors, simulators, or even stochastic parrots. We instead conceptualize LLMs by drawing on the theory of active inference originating in cognitive science and neuroscience. We examine similarities and differences between traditional active inference systems and LLMs, leading to the conclusion that, currently, LLMs lack a tight feedback loop between acting in the world and perceiving the impacts of their actions, but otherwise fit in the active inference paradigm. We list reasons why this loop may soon be closed, and possible consequences of this including enhanced model self-awareness and the drive to minimize prediction error by changing the world.


title: Bayesian mechanics of self-organising systems

abstract: Bayesian mechanics is a framework that addresses dynamical systems that can be conceptualised as Bayesian inference. However, the elucidation of requisite generative models is required for empirical applications to realistic self-organising systems. This work shows that the Hamiltonian of generic dynamical systems constitutes a class of generative models, thus rendering their Helmholtz energy naturally equivalent to variational free energy under the identified generative model. The self-organisation that minimises the Helmholtz energy entails matching the system's Hamiltonian with that of the environment, leading to an ensuing emergence of their generalised synchrony. In short, these self-organising systems can be read as performing variational Bayesian inference of the interacting environment. These properties have been demonstrated with coupled oscillators, simulated and living neural networks, and quantum computers. This notion offers foundational characterisations and predictions regarding asymptotic properties of self-organising systems exchanging with the environment, providing insights into potential mechanisms underlying emergence of intelligence.


title: A Language and Its Dimensions: Intrinsic Dimensions of Language Fractal Structures

abstract: The present paper introduces a novel object of study - a language fractal structure. We hypothesize that a set of embeddings of all $n$-grams of a natural language constitutes a representative sample of this fractal set. (We use the term Hailonakea to refer to the sum total of all language fractal structures, over all $n$). The paper estimates intrinsic (genuine) dimensions of language fractal structures for the Russian and English languages. To this end, we employ methods based on (1) topological data analysis and (2) a minimum spanning tree of a data graph for a cloud of points considered (Steele theorem). For both languages, for all $n$, the intrinsic dimensions appear to be non-integer values (typical for fractal sets), close to 9 for both of the Russian and English language.


title: Layer-to-Layer Melt Pool Control in Laser Power Bed Fusion

abstract: Additive manufacturing processes are flexible and efficient technologies for producing complex geometries. However, ensuring reliability and repeatability is challenging due to the complex physics and various sources of uncertainty in the process. In this work, we investigate closed-loop control of the melt pool dimensions in a laser powder bed fusion (LPBF) process. We propose a trajectory optimization-based layer-to-layer controller that adjusts the laser power input to the next layer to track a desired melt pool depth and validate our controller by placing it in closed-loop high-fidelity multi-layer smoothed particle hydrodynamics simulator of a 2D LPBF process. Detailed numerical case studies demonstrate successful regulation of the melt pool depth on brick and overhang geometries and provide first of its kind results on the effectiveness of layer-to-layer input optimization for the LPBF process as well as detailed insight into the physics of the controlled process. Computational complexity and process performance results illustrate the method's effectiveness and provide an outlook for its implementation onto real systems.


title: Measuring Moral Dimensions in Social Media with Mformer

abstract: The ever-growing textual records of contemporary social issues, often discussed online with moral rhetoric, present both an opportunity and a challenge for studying how moral concerns are debated in real life. Moral foundations theory is a taxonomy of intuitions widely used in data-driven analyses of online content, but current computational tools to detect moral foundations suffer from the incompleteness and fragility of their lexicons and from poor generalization across data domains. In this paper, we fine-tune a large language model to measure moral foundations in text based on datasets covering news media and long- and short-form online discussions. The resulting model, called Mformer, outperforms existing approaches on the same domains by 4--12% in AUC and further generalizes well to four commonly used moral text datasets, improving by up to 17% in AUC. We present case studies using Mformer to analyze everyday moral dilemmas on Reddit and controversies on Twitter, showing that moral foundations can meaningfully describe people's stance on social issues and such variations are topic-dependent. Pre-trained model and datasets are released publicly. We posit that Mformer will help the research community quantify moral dimensions for a range of tasks and data domains, and eventually contribute to the understanding of moral situations faced by humans and machines.


title: A Chern-Simons approach to self-dual gravity in (2+1)-dimensions and quantisation of Poisson structure

abstract: The (2+1)-dimensional analog self-dual gravity which is obtained via dimension reduction of the (3+1)-dimensional Holst action without reducing the internal gauge group is studied. A Chern-Simons formulation for this theory is constructed based on the gauge group $SL(2,\CC)_\RR\rcross \Rsix$ and maps the 3d complex self-dual dynamical variable and connection to $6d$ real variables which combines into a $12d$ Cartan connection. Quantization is given by the application of the combinatorial quantisation program of Chern-Simons theory. The Poisson structure for the moduli space of flat connections on $(SL(2,\CC)_\RR\rcross \Rsix)^{n+2g}$ which emerges in the combinatorial description of the phase space on $\RR \times \Sigma_{g,n},$ where $\Sigma_{g,n}$ is a genus $g$ surface with $n$ punctures is given in terms of the classical $r$-matrix for the quantum double $D(SL(2,\CC)_\RR)$ viewed as the double of a double $ D(SU(2)\dcross AN(2))$. This quantum double provides a feature for quantum symmetries of the quantum theory for the model.


title: An Active-Sensing Approach for Bearing-based Target Localization

abstract: Characterized by a cross-disciplinary nature, the bearing-based target localization task involves estimating the position of an entity of interest by a group of agents capable of collecting noisy bearing measurements. In this work, this problem is tackled by resting both on the weighted least square estimation approach and on the active-sensing control paradigm. Indeed, we propose an iterative algorithm that provides an estimate of the target position under the assumption of Gaussian noise distribution, which can be considered valid when more specific information is missing. Then, we present a seeker agents control law that aims at minimizing the localization uncertainty by optimizing the covariance matrix associated with the estimated target position. The validity of the designed bearing-based target localization solution is confirmed by the results of an extensive Monte Carlo simulation campaign.


title: Mimicking Classical Noise in Ion Channels by Quantum Decoherence

abstract: The mechanism of selectivity in ion channels is still an open question in biology. According to recent proposals, it seems that the selectivity filter of the ion channel, which plays a key role in the channel's function, may show quantum coherence, which can play a role in explaining the selection mechanism and conduction of ions. However, due to decoherence theory, the presence of environmental noise causes decoherence and loss of quantum effects. Sometimes we hope that the effect of calssical noise of the environment in ion channels can be modeled through a picture whose the quantum decoherence theory presents. In this paper, we simulated the behavior of the ion channel system in the Spin-Boson model using the unitary evolution of a stochastic Hamiltonian operator under the classical noise model. Also, in a different approach, we modeled the system evolution as a two-level Spin-Boson model with tunneling interacting with a bath of harmonic oscillators, using decoherence theory. The results of this system were discussed in different classical and quantum regimes. By examining the results it was found that the Spin-Boson model at a high hopping rate of Potassium ions can simulate the behavior of the system in the classical noise approach. This result is another proof for the fact that ion channels need high speed for high selectivity.


title: Asymptotically Fair Participation in Machine Learning Models: an Optimal Control Perspective

abstract: The performance of state-of-the-art machine learning models often deteriorates when testing on demographics that are under-represented in the training dataset. This problem has predominately been studied in a supervised learning setting where the data distribution is static. However, real-world applications often involve distribution shifts caused by the deployed models. For instance, the performance disparity against monitory users can lead to a high customer churn rate, thus the available data provided by active users are skewed due to the lack of minority users. This feedback effect further exacerbates the disparity among different demographic groups in future steps. To address this issue, we propose asymptotically fair participation as a condition to maintain long-term model performance over all demographic groups. In this work, we aim to address the problem of achieving asymptotically fair participation via optimal control formulation. Moreover, we design a surrogate retention system based on existing literature on evolutionary population dynamics to approximate the dynamics of distribution shifts on active user counts, from which the objective of achieving asymptotically fair participation is formulated as an optimal control problem, and the control variables are considered as the model parameters. We apply an efficient implementation of Pontryagin's maximum principle to estimate the optimal control solution. To evaluate the effectiveness of the proposed method, we design a generic simulation environment that simulates the population dynamics of the feedback effect between user retention and model performance. When we deploy the resulting models to the simulation environment, the optimal control solution accounts for long-term planning and leads to superior performance compared with existing baseline methods.


title: CV-Attention UNet: Attention-based UNet for 3D Cerebrovascular Segmentation of Enhanced TOF-MRA Images

abstract: Due to the lack of automated methods, to diagnose cerebrovascular disease, time-of-flight magnetic resonance angiography (TOF-MRA) is assessed visually, making it time-consuming. The commonly used encoder-decoder architectures for cerebrovascular segmentation utilize redundant features, eventually leading to the extraction of low-level features multiple times. Additionally, convolutional neural networks (CNNs) suffer from performance degradation when the batch size is small, and deeper networks experience the vanishing gradient problem. Methods: In this paper, we attempt to solve these limitations and propose the 3D cerebrovascular attention UNet method, named CV-AttentionUNet, for precise extraction of brain vessel images. We proposed a sequence of preprocessing techniques followed by deeply supervised UNet to improve the accuracy of segmentation of the brain vessels leading to a stroke. To combine the low and high semantics, we applied the attention mechanism. This mechanism focuses on relevant associations and neglects irrelevant anatomical information. Furthermore, the inclusion of deep supervision incorporates different levels of features that prove to be beneficial for network convergence. Results: We demonstrate the efficiency of the proposed method by cross-validating with an unlabeled dataset, which was further labeled by us. We believe that the novelty of this algorithm lies in its ability to perform well on both labeled and unlabeled data with image processing-based enhancement. The results indicate that our method performed better than the existing state-of-the-art methods on the TubeTK dataset. Conclusion: The proposed method will help in accurate segmentation of cerebrovascular structure leading to stroke


title: ell-adic topological Jacquet-Langlands duality

abstract: We embed the Lubin-Tate tower into a larger tower of formal schemes, the "degenerating Lubin-Tate tower." We construct a topological realization of the degenerating Lubin-Tate tower, i.e., a compatible family of presheaves of $E_{\infty}$-ring spectra on the \'{e}tale site of each formal scheme in the degenerating Lubin-Tate tower, which agrees on the base of the tower with the Goerss-Hopkins presheaf on Lubin-Tate space. We define and prove basic properties of nearby cycle and vanishing cycle presheaves of spectra on formal schemes. We apply these constructions to our spectrally-enriched degenerating Lubin-Tate tower to produce, for every spectrum $X$, an "$\ell$-adic topological Jacquet-Langlands (TJL) dual" of $X$. We prove that there is a correspondence between: 1. certain irreducible representations of $Aut(\mathbb{G})$ occurring in $(\mathcal{K}(E(\mathbb{G}))^{\wedge}_{\ell})_*(X)$, and 2. certain supercuspidal irreducible representations of $GL_n$ occuring in the rational homotopy groups of the TJL dual of $X$. Here $E(\mathbb{G})$ is the Morava $E$-theory spectrum of a height $n$ formal group $\mathbb{G}$, and $\mathcal{K}(E(\mathbb{G}))^{\wedge}_{\ell}$ is its algebraic $K$-theory spectrum completed away from the characteristic of the ground field of $\mathbb{G}$. Finally, we prove that at height $1$, TJL duality preserves the $L$-factors. This means that the automorphic $L$-factor of the $GL_1$-representation associated to $(\mathcal{K}(E(\mathbb{G}))^{\wedge}_{\ell})_*(X)$ by TJL duality is precisely the $p$-local Euler factor in a meromorphic $L$-function whose special values in the left half-plane recover the orders of the $KU$-local stable homotopy groups of $X$.


title: Aspherical Complex Surfaces, the Singer Conjecture, and Gromov-L\"uck Inequality $\chi \geq |\sigma|$

abstract: We discuss the Singer conjecture and Gromov-L\"uck inequality $\chi \geq |\sigma|$ for aspherical complex surfaces. We give a proof of the Singer conjecture for aspherical complex surface with residually finite fundamental group that does not rely on Gromov's K\"ahler groups theory. Without the residually finiteness assumption, we observe that this conjecture can be proven for all aspherical complex surfaces except possibly those in Class $\mathrm{VII}_0^+$ (a positive answer to the global spherical shell conjecture would rule out the existence of aspherical surfaces in this class). We also sharpen Gromov's inequality for aspherical complex surfaces that are not in Class $\mathrm{VII}_0^+$. This is achieved by connecting the circle of ideas of the Singer conjecture with the study of Reid's conjecture.


title: Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilities

abstract: Human interactions are deeply rooted in the interplay of thoughts, beliefs, and desires made possible by Theory of Mind (ToM): our cognitive ability to understand the mental states of ourselves and others. Although ToM may come naturally to us, emulating it presents a challenge to even the most advanced Large Language Models (LLMs). Recent improvements to LLMs' reasoning capabilities from simple yet effective prompting techniques such as Chain-of-Thought have seen limited applicability to ToM. In this paper, we turn to the prominent cognitive science theory "Simulation Theory" to bridge this gap. We introduce SimToM, a novel two-stage prompting framework inspired by Simulation Theory's notion of perspective-taking. To implement this idea on current ToM benchmarks, SimToM first filters context based on what the character in question knows before answering a question about their mental state. Our approach, which requires no additional training and minimal prompt-tuning, shows substantial improvement over existing methods, and our analysis reveals the importance of perspective-taking to Theory-of-Mind capabilities. Our findings suggest perspective-taking as a promising direction for future research into improving LLMs' ToM capabilities.


title: A Graphical Model of Hurricane Evacuation Behaviors

abstract: Natural disasters such as hurricanes are increasing and causing widespread devastation. People's decisions and actions regarding whether to evacuate or not are critical and have a large impact on emergency planning and response. Our interest lies in computationally modeling complex relationships among various factors influencing evacuation decisions. We conducted a study on the evacuation of Hurricane Irma of the 2017 Atlantic hurricane season. The study was guided by the Protection motivation theory (PMT), a widely-used framework to understand people's responses to potential threats. Graphical models were constructed to represent the complex relationships among the factors involved and the evacuation decision. We evaluated different graphical structures based on conditional independence tests using Irma data. The final model largely aligns with PMT. It shows that both risk perception (threat appraisal) and difficulties in evacuation (coping appraisal) influence evacuation decisions directly and independently. Certain information received from media was found to influence risk perception, and through it influence evacuation behaviors indirectly. In addition, several variables were found to influence both risk perception and evacuation behaviors directly, including family and friends' suggestions, neighbors' evacuation behaviors, and evacuation notices from officials.


title: Multi-messenger astrophysics in the gravitational-wave era

abstract: The observation of GW170817, the first binary neutron star merger observed in both gravitational waves (GW) and electromagnetic (EM) waves, kickstarted the age of multi-messenger GW astronomy. This new technique presents an observationally rich way to probe extreme astrophysical processes. With the onset of the LIGO-Virgo-KAGRA Collaboration's O4 observing run and wide-field EM instruments well-suited for transient searches, multi-messenger astrophysics has never been so promising. We review recent searches and results for multi-messenger counterparts to GW events, and describe existing and upcoming EM follow-up facilities, with a particular focus on WINTER, a new near-infrared survey telescope, and TESS, an exoplanet survey space telescope.


title: Compatibility between theoretical predictions and experimental data for top-antitop hadroproduction at NNLO QCD accuracy

abstract: We compare double-differential normalized production cross sections for top-antitop $+ X$ hadroproduction at NNLO QCD accuracy, as obtained through a customized version of the MATRIX framework interfaced to PineAPPL, with recent data by the ATLAS and CMS collaborations. We take into account theory uncertainties due to scale variation and we see how predictions vary as a function of parton distribution function (PDF) choice and top-quark pole mass value, considering different state-of-the-art PDF fits with their uncertainties. Notwithstanding the overall reasonable good agreement, we observe discrepancies at the level of a few $\sigma$'s between data and theoretical predictions in some kinematical regions, which can be alleviated by refitting the top-quark mass value, and/or the PDFs and/or $\alpha_s(M_Z)$, considering the correlations between these three quantities. In a fit of top-quark mass standalone, we notice that, for all considered PDF + $\alpha_s(M_Z)$ sets used as input, some datasets point towards top-quark pole mass values lower by about $2\,\sigma$'s than those emerging from fitting other datasets, suggesting a possible tension between experimental measurements using different decay channels, and/or the need of better estimating uncertainties on the latter.


title: Saddle avoidance of noise-induced transitions in multiscale systems

abstract: In multistable dynamical systems driven by weak Gaussian noise, transitions between competing states are often assumed to pass via a saddle on the separating basin boundary. Instead, we show that timescale separation can cause saddle avoidance in non-gradient systems. Using toy models from neuroscience and ecology, we study cases where sample transitions deviate strongly from the instanton predicted by Freidlin-Wentzell theory, even for weak finite noise. We attribute this to a flat quasipotential and present an approach based on the Onsager-Machlup action to aptly predict transition paths.

categories: math.DS cond-mat.stat-mech q-bio.NC q-bio.PE


title: Giant Outer Transiting Exoplanet Mass (GOT 'EM) Survey: III. Recovery and Confirmation of a Temperate, Mildly Eccentric, Single-Transit Jupiter Orbiting TOI-2010

abstract: Large-scale exoplanet surveys like the TESS mission are powerful tools for discovering large numbers of exoplanet candidates. Single-transit events are commonplace within the resulting candidate list due to the unavoidable limitation of observing baseline. These single-transit planets often remain unverified due to their unknown orbital period and consequent difficulty in scheduling follow up observations. In some cases, radial velocity (RV) follow up can constrain the period enough to enable a future targeted transit detection. We present the confirmation of one such planet: TOI-2010 b. Nearly three years of RV coverage determined the period to a level where a broad window search could be undertaken with the Near-Earth Object Surveillance Satellite (NEOSSat), detecting an additional transit. An additional detection in a much later TESS sector solidified our final parameter estimation. We find TOI-2010 b to be a Jovian planet ($M_P = 1.29 \ M_{\rm Jup}$, $R_P = 1.05 \ R_{\rm Jup}$) on a mildly eccentric orbit ($e = 0.21$) with a period of $P = 141.83403$ days. Assuming a simple model with no albedo and perfect heat redistribution, the equilibrium temperature ranges from about 360 K to 450 K from apoastron to periastron. Its wide orbit and bright host star ($V=9.85$) make TOI-2010 b a valuable test-bed for future low-insolation atmospheric analysis.


title: Weight representations of affine Kac-Moody algebras and small quantum groups

abstract: We study the weight modules over affine Kac-Moody algebras from the view point of vertex algebras, and determine the abelian category of weight modules for the simple affine vertex algebra $L_k(\mathfrak{sl}_2)$ at any non-integral admissible level $k$. In particular, we show that the principal block of the category of weight modules over admissible $L_k(\mathfrak{sl}_2)$ is equivalent to that of the corresponding (unrolled) small quantum group.


title: The Analysis and Extraction of Structure from Organizational Charts

abstract: Organizational charts, also known as org charts, are critical representations of an organization's structure and the hierarchical relationships between its components and positions. However, manually extracting information from org charts can be error-prone and time-consuming. To solve this, we present an automated and end-to-end approach that uses computer vision, deep learning, and natural language processing techniques. Additionally, we propose a metric to evaluate the completeness and hierarchical accuracy of the extracted information. This approach has the potential to improve organizational restructuring and resource utilization by providing a clear and concise representation of the organizational structure. Our study lays a foundation for further research on the topic of hierarchical chart analysis.


title: Data-Driven LQR using Reinforcement Learning and Quadratic Neural Networks

abstract: This paper introduces a novel data-driven approach to design a linear quadratic regulator (LQR) using a reinforcement learning (RL) algorithm that does not require a system model. The key contribution is to perform policy iteration (PI) by designing the policy evaluator as a two-layer quadratic neural network (QNN). This network is trained through convex optimization. To the best of our knowledge, this is the first time that a QNN trained through convex optimization is employed as the Q-function approximator (QFA). The main advantage is that the QNN's input-output mapping has an analytical expression as a quadratic form, which can then be used to obtain an analytical expression for policy improvement. This is in stark contrast to the available techniques in the literature that must train a second neural network to obtain policy improvement. The article establishes the convergence of the learning algorithm to the optimal control, provided the system is controllable and one starts from a stabilitzing policy. A quadrotor example demonstrates the effectiveness of the proposed approach.


title: Latent Feature-based Data Splits to Improve Generalisation Evaluation: A Hate Speech Detection Case Study

abstract: With the ever-growing presence of social media platforms comes the increased spread of harmful content and the need for robust hate speech detection systems. Such systems easily overfit to specific targets and keywords, and evaluating them without considering distribution shifts that might occur between train and test data overestimates their benefit. We challenge hate speech models via new train-test splits of existing datasets that rely on the clustering of models' hidden representations. We present two split variants (Subset-Sum-Split and Closest-Split) that, when applied to two datasets using four pretrained models, reveal how models catastrophically fail on blind spots in the latent space. This result generalises when developing a split with one model and evaluating it on another. Our analysis suggests that there is no clear surface-level property of the data split that correlates with the decreased performance, which underscores that task difficulty is not always humanly interpretable. We recommend incorporating latent feature-based splits in model development and release two splits via the GenBench benchmark.


title: PINE: Efficient Norm-Bound Verification for Secret-Shared Vectors

abstract: Secure aggregation of high-dimensional vectors is a fundamental primitive in federated statistics and learning. A two-server system such as PRIO allows for scalable aggregation of secret-shared vectors. Adversarial clients might try to manipulate the aggregate, so it is important to ensure that each (secret-shared) contribution is well-formed. In this work, we focus on the important and well-studied goal of ensuring that each contribution vector has bounded Euclidean norm. Existing protocols for ensuring bounded-norm contributions either incur a large communication overhead, or only allow for approximate verification of the norm bound. We propose Private Inexpensive Norm Enforcement (PINE): a new protocol that allows exact norm verification with little communication overhead. For high-dimensional vectors, our approach has a communication overhead of a few percent, compared to the 16-32x overhead of previous approaches.


title: Thermally stable p-wave repulsive Fermi polaron without a two-body bound state

abstract: We theoretically investigate the polaron physics of an impurity immersed in a two-dimensional Fermi sea, interacting via a p-wave interaction at finite temperature. In the unitary limit with a divergent scattering area, we find a well-defined repulsive Fermi polaron at short interaction range, which shows a remarkable thermal stability with increasing temperature. The appearance of such a stable repulsive Fermi polaron in the resonantly interacting limit can be attributed to the existence of a quasi-bound dressed molecule state hidden in the two-particle continuum, although there is no bound state in the two-particle limit. We show that the repulsive Fermi polaron disappears when the interaction range increases or when the scattering area is tuned to the weakly-interacting regime. The large interaction range and small scattering area instead stabilize attractive Fermi polarons.


title: Calibration Unit Design for High-Resolution Infrared Spectrograph for Exoplanet Characterization (HISPEC)

abstract: The latest generation of high-resolution spectrograph instruments on 10m-class telescopes continue to pursue challenging science cases. Consequently, ever more precise calibration methods are necessary to enable trail-blazing science methodology. We present the High-resolution Infrared SPectrograph for Exoplanet Characterization (HISPEC) Calibration Unit (CAL), designed to facilitate challenging science cases such as Doppler imaging of exoplanet atmospheres, precision radial velocity, and high-contrast high-resolution spectroscopy of nearby exoplanets. CAL builds upon the heritage from the pathfinder instrument Keck Planet Imager and Characterizer (KPIC) and utilizes four near-infrared (NIR) light sources encoded with wavelength information that are coupled into single-mode fibers. They can be used synchronously during science observations or asynchronously during daytime calibrations. A hollow cathode lamp (HCL) and a series of gas absorption cells provide absolute calibration from 0.98 {\mu}m to 2.5 {\mu}m. A laser frequency comb (LFC) provides stable, time-independent wavelength information during observation and CAL implements a lower finesse astro-etalon as a backup for the LFC. Design lessons from instrumentation like HISPEC will serve to inform the requirements for similar instruments for the ELTs in the future.


title: Tensor categories of weight modules of $\widehat{\mathfrak{sl}}_2$ at admissible level

abstract: The category of weight modules $L_k(\mathfrak{sl}_2)\text{-wtmod}$ of the simple affine vertex algebra of $\mathfrak{sl}_2$ at an admissible level $k$ is neither finite nor semisimple and modules are usually not lower-bounded and have infinite dimensional conformal weight subspaces. However this vertex algebra enjoys a duality with $W_\ell(\mathfrak{sl}_{2|1})$, the simple prinicipal $W$-algebra of $\mathfrak{sl}_{2|1}$ at level $\ell$ (the $N=2$ super conformal algebra) where the levels are related via $(k+2)(\ell+1)=1$. Every weight module of $W_\ell(\mathfrak{sl}_{2|1})$ is lower-bounded and has finite-dimensional conformal weight spaces. The main technical result is that every weight module of $W_\ell(\mathfrak{sl}_{2|1})$ is $C_1$-cofinite. The existence of a vertex tensor category follows and the theory of vertex superalgebra extensions implies the existence of vertex tensor category structure on $L_k(\mathfrak{sl}_2)\text{-wtmod}$ for any admissible level $k$. As applications, the fusion rules of ordinary modules with any weight module are computed and it is shown that $L_k(\mathfrak{sl}_2)\text{-wtmod}$ is a ribbon category if and only if $L_{k+1}(\mathfrak{sl}_2)\text{-wtmod}$ is, in particular it follows that for admissible levels $k = - 2 + \frac{u}{v}$ and $v \in \{2, 3\}$ and $u = -1 \mod v$ the category $L_k(\mathfrak{sl}_2)\text{-wtmod}$ is a ribbon category.


title: Optimal squeezing for high-precision atom interferometers

abstract: We show that squeezing is a crucial resource for interferometers based on the spatial separation of ultra-cold interacting matter. Atomic interactions lead to a general limitation for the precision of these atom interferometers, which can neither be surpassed by larger atom numbers nor by conventional phase or number squeezing. However, tailored squeezed states allow to overcome this sensitivity bound by anticipating the major detrimental effect that arises from the interactions. We envisage applications in future high-precision differential matter-wave interferometers, in particular gradiometers, e.g., for gravitational-wave detection.

categories: physics.atom-ph astro-ph.CO cond-mat.quant-gas gr-qc quant-ph


title: Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers

abstract: The launch of ChatGPT has garnered global attention, marking a significant milestone in the field of Generative Artificial Intelligence. While Generative AI has been in effect for the past decade, the introduction of ChatGPT has ignited a new wave of research and innovation in the AI domain. This surge in interest has led to the development and release of numerous cutting-edge tools, such as Bard, Stable Diffusion, DALL-E, Make-A-Video, Runway ML, and Jukebox, among others. These tools exhibit remarkable capabilities, encompassing tasks ranging from text generation and music composition, image creation, video production, code generation, and even scientific work. They are built upon various state-of-the-art models, including Stable Diffusion, transformer models like GPT-3 (recent GPT-4), variational autoencoders, and generative adversarial networks. This advancement in Generative AI presents a wealth of exciting opportunities and, simultaneously, unprecedented challenges. Throughout this paper, we have explored these state-of-the-art models, the diverse array of tasks they can accomplish, the challenges they pose, and the promising future of Generative Artificial Intelligence.


title: First-order bulk transitions in large-$N$ lattice Yang--Mills theories using the density of states

abstract: We use the Logarithmic Linear Relaxation (LLR) density of states algorithm to study the bulk phase transitions of pure-gauge SU($N$) lattice Yang--Mills theories with $4 \leq N \leq 8$. This approach avoids super-critical slowing down at such transitions, which poses a problem for traditional importance sampling Monte-Carlo methods. We analyse the effect of different updating strategies within the LLR algorithm, different reconstruction techniques of the density of states and different lattice volumes. By comparing our results for the weakly first-order SU(5) bulk phase transition against those for the stronger transitions with $N \geq 6$, we demonstrate the advantages of the LLR method for analyses of strong transitions with large latent heat.


title: JediCode -- A Gamefied Approach to Competitive Coding

abstract: JediCode (name inspired from Star Wars) pioneers a transformative approach to competitive coding by infusing the challenge with gamified elements. This platform reimagines coding competitions, integrating real-time leaderboards, synchronized challenges, and random matchmaking, creating an engaging, dynamic, and friendly atmosphere. This paper explores JediCode's innovative features and architecture, shedding light on its user-centric design and powerful execution service. By embracing gamification, JediCode not only elevates the thrill of coding challenges but also fosters a sense of community, inspiring programmers to excel while enjoying the process.


title: Segment Anything in Defect Detection

abstract: Defect detection plays a crucial role in infrared non-destructive testing systems, offering non-contact, safe, and efficient inspection capabilities. However, challenges such as low resolution, high noise, and uneven heating in infrared thermal images hinder comprehensive and accurate defect detection. In this study, we propose DefectSAM, a novel approach for segmenting defects on highly noisy thermal images based on the widely adopted model, Segment Anything (SAM)\cite{kirillov2023segany}. Harnessing the power of a meticulously curated dataset generated through labor-intensive lab experiments and valuable prompts from experienced experts, DefectSAM surpasses existing state-of-the-art segmentation algorithms and achieves significant improvements in defect detection rates. Notably, DefectSAM excels in detecting weaker and smaller defects on complex and irregular surfaces, reducing the occurrence of missed detections and providing more accurate defect size estimations. Experimental studies conducted on various materials have validated the effectiveness of our solutions in defect detection, which hold significant potential to expedite the evolution of defect detection tools, enabling enhanced inspection capabilities and accuracy in defect identification.


title: Surprisal Driven $k$-NN for Robust and Interpretable Nonparametric Learning

abstract: Nonparametric learning is a fundamental concept in machine learning that aims to capture complex patterns and relationships in data without making strong assumptions about the underlying data distribution. Owing to simplicity and familiarity, one of the most well-known algorithms under this paradigm is the $k$-nearest neighbors ($k$-NN) algorithm. Driven by the usage of machine learning in safety-critical applications, in this work, we shed new light on the traditional nearest neighbors algorithm from the perspective of information theory and propose a robust and interpretable framework for tasks such as classification, regression, density estimation, and anomaly detection using a single model. We can determine data point weights as well as feature contributions by calculating the conditional entropy for adding a feature without the need for explicit model training. This allows us to compute feature contributions by providing detailed data point influence weights with perfect attribution and can be used to query counterfactuals. Instead of using a traditional distance measure which needs to be scaled and contextualized, we use a novel formulation of $\textit{surprisal}$ (amount of information required to explain the difference between the observed and expected result). Finally, our work showcases the architecture's versatility by achieving state-of-the-art results in classification and anomaly detection, while also attaining competitive results for regression across a statistically significant number of datasets.


title: Noncompactified Kaluza--Klein theories and Anisotropic Kantowski-Sachs Universe

abstract: We provide an overview of noncompactified Kaluza-Klein theories. The space-time-matter theory (or induced-matter theory) and the modified Brans-Dicke theory are discussed. Finally, an extended version of the Kantowski-Sachs anisotropic model is investigated as a cosmological application of the latter.


title: FedTruth: Byzantine-Robust and Backdoor-Resilient Federated Learning Framework

abstract: Federated Learning (FL) enables collaborative machine learning model training across multiple parties without sharing raw data. However, FL's distributed nature allows malicious clients to impact model training through Byzantine or backdoor attacks, using erroneous model updates. Existing defenses measure the deviation of each update from a 'ground-truth model update.' They often rely on a benign root dataset on the server or use trimmed mean or median for clipping, both methods having limitations. We introduce FedTruth, a robust defense against model poisoning in FL. FedTruth doesn't assume specific data distributions nor requires a benign root dataset. It estimates a global model update with dynamic aggregation weights, considering contributions from all benign clients. Empirical studies demonstrate FedTruth's efficacy in mitigating the impacts of poisoned updates from both Byzantine and backdoor attacks.


title: Resonance of Geometric Quantities and Hidden Symmetry in the Asymmetric Rabi Model

abstract: We present the interesting resonance of two kinds of geometric quantities, namely the Aharonov-Anandan (AA) phase and the time-energy uncertainty, and reveal the relation between resonance and the hidden symmetry in the asymmetric Rabi model by numerical and analytical methods. By combining the counter-rotating hybridized rotating-wave method with time-dependent perturbation theory, we solve systematically the time evolution operator and then obtain the geometric phase of the Rabi model. In comparison with the numerically exact solutions, we find that the analytical results accurately describe the geometric quantities in a wide parameter space. We unveil the effect of the bias on the resonance of geometric quantities, (1) the positions of all harmonic resonances stemming from the shift of the Rabi frequency at the presence of the bias; (2) the occurrence of even order harmonic resonance due to the bias. When the driving frequency is equal to the subharmonics of the bias, the odd higher-order harmonic resonances disappear. Finally, the hidden symmetry has a resemblance to that of the quantum Rabi model with bias, which indicates the quasienergy spectra are similar to the energy spectra of the latter.


title: Efficient multipartite entanglement purification with non-identical states

abstract: We present an efficient and general multipartite entanglement purification protocol (MEPP) for N-photon systems in Greenberger-Horne-Zeilinger (GHZ) states with non-identical input states. As a branch of entanglement purification, besides the cases of successful purification, the recurrence MEPP actually has the reusable discarded items which are usually regarded as a failure. Our protocol contains two parts for bit-flip error correction. The first one is the conventional MEPP, corresponding successful cases. The second one includes two efficient approaches, recycling purification with entanglement link and direct residual entanglement purification, that can utilize discarded items. We also make a comparison between two approaches. Which method to use depends on initial input states, and in most cases the approach of direct residual purification is optimal for it not only may obtain a higher fidelity entangled state but also it does not require additional sophisticated links. In addition, for phase-flip errors, the discarded items still have available residual entanglement in the case of different input states. With these approaches, this MEPP has a higher efficiency than all previous MEPPs and it may have potential applications in the future long-distance quantum communications and networks.


title: UniMOS: A Universal Framework For Multi-Organ Segmentation Over Label-Constrained Datasets

abstract: Machine learning models for medical images can help physicians diagnose and manage diseases. However, due to the fact that medical image annotation requires a great deal of manpower and expertise, as well as the fact that clinical departments perform image annotation based on task orientation, there is the problem of having fewer medical image annotation data with more unlabeled data and having many datasets that annotate only a single organ. In this paper, we present UniMOS, the first universal framework for achieving the utilization of fully and partially labeled images as well as unlabeled images. Specifically, we construct a Multi-Organ Segmentation (MOS) module over fully/partially labeled data as the basenet and designed a new target adaptive loss. Furthermore, we incorporate a semi-supervised training module that combines consistent regularization and pseudolabeling techniques on unlabeled data, which significantly improves the segmentation of unlabeled data. Experiments show that the framework exhibits excellent performance in several medical image segmentation tasks compared to other advanced methods, and also significantly improves data utilization and reduces annotation cost. Code and models are available at: https://github.com/lw8807001/UniMOS.


title: Cislunar Satellite Constellation Design Via Integer Linear Programming

abstract: Cislunar space awareness is of increasing interest to the international community as Earth-Moon traffic is projected to increase. This raises the problem of placing satellites optimally in a constellation to provide satisfactory coverage for said traffic. The Circular Restricted 3 Body Problem (CR3BP) provides promising periodic orbits in the Earth-Moon rotating frame for traffic monitoring. This work converts a spatially and temporally varying traffic coverage requirement into an integer linear programming problem, attempting to minimize the number of satellites required for the requested coverage.


title: Towards Stronger Blockchains: Security Against Front-Running Attacks

abstract: Blockchains add transactions to a distributed shared ledger by arriving at consensus on sets of transactions contained in blocks. This provides a total ordering on a set of global transactions. However, total ordering is not enough to satisfy application semantics under the Byzantine fault model. This is due to the fact that malicious miners and clients can collaborate to add their own transactions ahead of correct clients' transactions in order to gain application level and financial advantages. These attacks fall under the umbrella of front-running attacks. Therefore, total ordering is not strong enough to preserve application semantics. In this paper, we propose causality preserving total order as a solution to this problem. The resulting Blockchains will be stronger than traditional consensus based blockchains and will provide enhanced security ensuring correct application semantics in a Byzantine setting.


title: Central Extension of Scaling Poincar\'e Algebra

abstract: We discuss the possibility of a central extension of the Poincar\'e algebra and the scaling Poincar\'e algebra. In more than two space-time dimensions, all the central extensions are trivial and can be removed. In two space-time dimensions, both the Poincar\'e algebra and the scaling Poincar\'e algebra have distinct non-trivial central extensions that cannot be removed. In higher dimensions, the central charges between dilatation and global $U(1)$ symmetry may not be removed. Based on these central extensions, we give some examples of projective representations of the (scaling) Poincar\'e symmetry in two dimensions.


title: FREE: The Foundational Semantic Recognition for Modeling Environmental Ecosystems

abstract: Modeling environmental ecosystems is critical for the sustainability of our planet, but is extremely challenging due to the complex underlying processes driven by interactions amongst a large number of physical variables. As many variables are difficult to measure at large scales, existing works often utilize a combination of observable features and locally available measurements or modeled values as input to build models for a specific study region and time period. This raises a fundamental question in advancing the modeling of environmental ecosystems: how to build a general framework for modeling the complex relationships amongst various environmental data over space and time? In this paper, we introduce a new framework, FREE, which maps available environmental data into a text space and then converts the traditional predictive modeling task in environmental science to the semantic recognition problem. The proposed FREE framework leverages recent advances in Large Language Models (LLMs) to supplement the original input features with natural language descriptions. This facilitates capturing the data semantics and also allows harnessing the irregularities of input features. When used for long-term prediction, FREE has the flexibility to incorporate newly collected observations to enhance future prediction. The efficacy of FREE is evaluated in the context of two societally important real-world applications, predicting stream water temperature in the Delaware River Basin and predicting annual corn yield in Illinois and Iowa. Beyond the superior predictive performance over multiple baseline methods, FREE is shown to be more data- and computation-efficient as it can be pre-trained on simulated data generated by physics-based models.


title: Exploring User Perceptions of Virtual Reality Scene Design in Metaverse Learning Environments

abstract: Metaverse learning environments allow for a seamless and intuitive transition between activities compared to Virtual Reality (VR) learning environments, due to their interconnected design. The design of VR scenes is important for creating effective learning experiences in the Metaverse. However, there is limited research on the impact of different design elements on user's learning experiences in VR scenes. To address this, a study was conducted with 16 participants who interacted with two VR scenes, each with varying design elements such as style, color, texture, object, and background, while watching a short tutorial. Participant rankings of the scenes for learning were obtained using a seven-point Likert scale, and the Mann-Whitney U test was used to validate differences in preference between the scenes. The results showed a significant difference in preference between the scenes. Further analysis using the NASA TLX questionnaire was conducted to examine the impact of this difference on cognitive load, and participant feedback was also considered. The study emphasizes the importance of careful VR scene design to improve the user's learning experience.


title: On the virtually cyclic dimension of normally poly-free groups

abstract: In this note we give an upper bound for the virtually cyclic dimension of any normally poly-free group in terms of its length. In particular, this implies that virtually even Artin groups of FC-type admit a finite dimensional model for the classifying space with respect to the family of virtually cyclic subgroups.


title: Uniform regularity for degenerate elliptic equations in perforated domains

abstract: This paper is concerned with a class of degenerate elliptic equations with rapidly oscillating coefficients in periodically perforated domains, which arises in the study of spectrum problems for uniformly elliptic equations in perforated domains. We establish a quantitative convergence rate and obtain the uniform weighted Lipschitz and $W^{1,p}$ estimates.


title: Potentials for general-relativistic geodesy

abstract: Geodesy in a Newtonian framework is based on the Newtonian gravitational potential. The general-relativistic gravitational field, however, is not fully determined by a single potential. The vacuum field around a stationary source can be decomposed into two scalar potentials and a tensorial spatial metric, which together serve as the basis for general-relativistic geodesy. One of the scalar potentials is a generalization of the Newtonian potential while the second one describes the influence of the rotation of the source on the gravitational field for which no non-relativistic counterpart exists. In this paper the operational realizations of these two potentials, and also of the spatial metric, are discussed. For some analytically given spacetimes the two potentials are exemplified and their relevance for practical geodesy on Earth is outlined.


title: igraph enables fast and robust network analysis across programming languages

abstract: Networks or graphs are widely used across the sciences to represent relationships of many kinds. igraph (https://igraph.org) is a general-purpose software library for graph construction, analysis, and visualisation, combining fast and robust performance with a low entry barrier. igraph pairs a fast core written in C with beginner-friendly interfaces in Python, R, and Mathematica. Over the last two decades, igraph has expanded substantially. It now scales to billions of edges, supports Mathematica and interactive plotting, integrates with Jupyter notebooks and other network libraries, includes new graph layouts and community detection algorithms, and has streamlined the documentation with examples and Spanish translations. Modern testing features such as continuous integration, address sanitizers, stricter typing, and memory-managed vectors have also increased robustness. Hundreds of bug reports have been fixed and a community forum has been opened to connect users and developers. Specific effort has been made to broaden use and community participation by women, non-binary people, and other demographic groups typically underrepresented in open source software.


title: Vision meets mmWave Radar: 3D Object Perception Benchmark for Autonomous Driving

abstract: Sensor fusion is crucial for an accurate and robust perception system on autonomous vehicles. Most existing datasets and perception solutions focus on fusing cameras and LiDAR. However, the collaboration between camera and radar is significantly under-exploited. The incorporation of rich semantic information from the camera, and reliable 3D information from the radar can potentially achieve an efficient, cheap, and portable solution for 3D object perception tasks. It can also be robust to different lighting or all-weather driving scenarios due to the capability of mmWave radars. In this paper, we introduce the CRUW3D dataset, including 66K synchronized and well-calibrated camera, radar, and LiDAR frames in various driving scenarios. Unlike other large-scale autonomous driving datasets, our radar data is in the format of radio frequency (RF) tensors that contain not only 3D location information but also spatio-temporal semantic information. This kind of radar format can enable machine learning models to generate more reliable object perception results after interacting and fusing the information or features between the camera and radar.


title: On the dimension of limit sets on $\mathbb{P}(\mathbb{R}^3)$ via stationary measures: variational principles and applications

abstract: In this article, we establish the variational principle of the affinity exponent of Borel Anosov representations. We also establish such a principle of the Rauzy gasket. In Li-Pan-Xu, they obtain a dimension formula of the stationary measures on $\mathbb{P}(\mathbb{R}^3)$. Combined with our result, it allows us to study the Hausdorff dimension of limit sets of Anosov representations in $\mathrm{SL}_3(\mathbb{R})$ and the Rauzy gasket. It yields the equality between the Hausdorff dimensions and the affinity exponents in both settings. In the appendix, we improve the numerical lower bound of the Hausdorff dimension of Rauzy gasket to $1.5$.


title: Stable Differentiable Causal Discovery

abstract: Inferring causal relationships as directed acyclic graphs (DAGs) is an important but challenging problem. Differentiable Causal Discovery (DCD) is a promising approach to this problem, framing the search as a continuous optimization. But existing DCD methods are numerically unstable, with poor performance beyond tens of variables. In this paper, we propose Stable Differentiable Causal Discovery (SDCD), a new method that improves previous DCD methods in two ways: (1) It employs an alternative constraint for acyclicity; this constraint is more stable, both theoretically and empirically, and fast to compute. (2) It uses a training procedure tailored for sparse causal graphs, which are common in real-world scenarios. We first derive SDCD and prove its stability and correctness. We then evaluate it with both observational and interventional data and on both small-scale and large-scale settings. We find that SDCD outperforms existing methods in both convergence speed and accuracy and can scale to thousands of variables. We provide code at https://github.com/azizilab/sdcd.


title: Dynamic Instability of Follower Forced Euler Bernoulli Cantilever Beam With Tip Mass

abstract: This work focuses on the stability analysis of an Euler Bernoulli cantilever beam with a tip mass at the free end, subject to a follower force. This can serve as a viable model for analysis of elastic instability occurring due to fluid-structure interaction of structural components submerged in fluids and gases. A linear model with appropriate boundary conditions is developed using the energy formulation. The characteristic equation of the linear model establishes the relationship between the pulsation of the beam and the magnitude of applied follower force. The evolution of temporal eigenvalues with respect to the magnitude of the follower force helps in evaluation of the critical follower forces responsible for different modes of instability. The presented model demonstrates the existence of only dynamic instability in the system. Furthermore, the model predicts that both types of the dynamic instability i.e., flutter and divergence, are possible in the system.


title: On the dimension of limit sets on $\mathbb{P}(\mathbb{R}^3)$ via stationary measures: the theory and applications

abstract: This paper investigates the (semi)group action of $\mathrm{SL}_3(\mathbb{R})$ on $\mathbb{P}(\mathbb{R}^3)$, a primary example of non-conformal, non-linear, and non-strictly contracting action. We study the Hausdorff dimension of a dynamically defined limit set in $\mathbb{P}(\mathbb{R}^3)$ and generalize the classical Patterson-Sullivan formula using the approach of stationary measures. The two main examples are Anosov representations in $\mathrm{SL}_3(\mathbb{R})$ and the Rauzy gasket. 1. For Anosov representations in $\mathrm{SL}_3(\mathbb{R})$, we establish a sharp lower bound for the dimension of their limit sets in $\mathbb{P}(\mathbb{R}^3)$. Coupled with the upper bound in Pozzetti-Sambarino-Wienhard, it shows that their Hausdorff dimensions equal the affinity exponents. The merit of our approach is that it works uniformly for all the components of irreducible Anosov representations in $\mathrm{SL}_3(\mathbb{R})$. As an application, it reveals a surprising dimension jump phenomenon in the Barbot component, which is a local generalization of Bowen's dimension rigidity result. 2. For the Rauzy gasket, we confirm a folklore conjecture about the Hausdorff dimension of the gasket and improve the numerical lower bound to $3/2$. These results originate from a dimension formula of stationary measures on $\mathbb{P}(\mathbb{R}^3)$. Let $\nu$ be a probability measure on $\mathrm{SL}_3(\mathbb{R})$ whose support is finite and spans a Zariski dense subgroup. Let $\mu$ be the associated stationary measure for the action on $\mathbb{P}(\mathbb{R}^3)$. Under the exponential separation condition on $\nu$, we prove that the Hausdorff dimension of $\mu$ equals its Lyapunov dimension, which extends Hochman-Solomyak and B\'{a}r\'{a}ny-Hochman-Rapaport to non-conformal and projective settings respectively.


title: Diagnosing and Debiasing Corpus-Based Political Bias and Insults in GPT2

abstract: The training of large language models (LLMs) on extensive, unfiltered corpora sourced from the internet is a common and advantageous practice. Consequently, LLMs have learned and inadvertently reproduced various types of biases, including violent, offensive, and toxic language. However, recent research shows that generative pretrained transformer (GPT) language models can recognize their own biases and detect toxicity in generated content, a process referred to as self-diagnosis. In response, researchers have developed a decoding algorithm that allows LLMs to self-debias, or reduce their likelihood of generating harmful text. This study investigates the efficacy of the diagnosing-debiasing approach in mitigating two additional types of biases: insults and political bias. These biases are often used interchangeably in discourse, despite exhibiting potentially dissimilar semantic and syntactic properties. We aim to contribute to the ongoing effort of investigating the ethical and social implications of human-AI interaction.


title: Energy and Carbon Considerations of Fine-Tuning BERT

abstract: Despite the popularity of the `pre-train then fine-tune' paradigm in the NLP community, existing work quantifying energy costs and associated carbon emissions has largely focused on language model pre-training. Although a single pre-training run draws substantially more energy than fine-tuning, fine-tuning is performed more frequently by many more individual actors, and thus must be accounted for when considering the energy and carbon footprint of NLP. In order to better characterize the role of fine-tuning in the landscape of energy and carbon emissions in NLP, we perform a careful empirical study of the computational costs of fine-tuning across tasks, datasets, hardware infrastructure and measurement modalities. Our experimental results allow us to place fine-tuning energy and carbon costs into perspective with respect to pre-training and inference, and outline recommendations to NLP researchers and practitioners who wish to improve their fine-tuning energy efficiency.


title: The MAGPI Survey: Drivers of kinematic asymmetries in the ionised gas of $z\sim0.3$ star-forming galaxies

abstract: Galaxy gas kinematics are sensitive to the physical processes that contribute to a galaxy's evolution. It is expected that external processes will cause more significant kinematic disturbances in the outer regions, while internal processes will cause more disturbances for the inner regions. Using a subsample of 47 galaxies ($0.27<z<0.36$) from the Middle Ages Galaxy Properties with Integral Field Spectroscopy (MAGPI) survey, we conduct a study into the source of kinematic disturbances by measuring the asymmetry present in the ionised gas line-of-sight velocity maps at the $0.5R_e$ (inner regions) and $1.5R_e$ (outer regions) elliptical annuli. By comparing the inner and outer kinematic asymmetries, we aim to better understand what physical processes are driving the asymmetries in galaxies. We find the local environment plays a role in kinematic disturbance, in agreement with other integral field spectroscopy studies of the local universe, with most asymmetric systems being in close proximity to a more massive neighbour. We do not find evidence suggesting that hosting an Active Galactic Nucleus (AGN) contributes to asymmetry within the inner regions, with some caveats due to emission line modelling. In contrast to previous studies, we do not find evidence that processes leading to asymmetry also enhance star formation in MAGPI galaxies. Finally, we find a weak anti-correlation between stellar mass and asymmetry (ie. high stellar mass galaxies are less asymmetric). We conclude by discussing possible sources driving the asymmetry in the ionised gas, such as disturbances being present in the colder gas phase (either molecular or atomic) prior to the gas being ionised, and non-axisymmetric features (e.g., a bar) being present in the galactic disk. Our results highlight the complex interplay between ionised gas kinematic disturbances and physical processes involved in galaxy evolution.


title: Interpretable pap smear cell representation for cervical cancer screening

abstract: Screening is critical for prevention and early detection of cervical cancer but it is time-consuming and laborious. Supervised deep convolutional neural networks have been developed to automate pap smear screening and the results are promising. However, the interest in using only normal samples to train deep neural networks has increased owing to class imbalance problems and high-labeling costs that are both prevalent in healthcare. In this study, we introduce a method to learn explainable deep cervical cell representations for pap smear cytology images based on one class classification using variational autoencoders. Findings demonstrate that a score can be calculated for cell abnormality without training models with abnormal samples and localize abnormality to interpret our results with a novel metric based on absolute difference in cross entropy in agglomerative clustering. The best model that discriminates squamous cell carcinoma (SCC) from normals gives 0.908 +- 0.003 area under operating characteristic curve (AUC) and one that discriminates high-grade epithelial lesion (HSIL) 0.920 +- 0.002 AUC. Compared to other clustering methods, our method enhances the V-measure and yields higher homogeneity scores, which more effectively isolate different abnormality regions, aiding in the interpretation of our results. Evaluation using in-house and additional open dataset show that our model can discriminate abnormality without the need of additional training of deep models.


title: Multiscale Hodge Scattering Networks for Data Analysis

abstract: We propose new scattering networks for signals measured on simplicial complexes, which we call \emph{Multiscale Hodge Scattering Networks} (MHSNs). Our construction is based on multiscale basis dictionaries on simplicial complexes, i.e., the $\kappa$-GHWT and $\kappa$-HGLET, which we recently developed for simplices of dimension $\kappa \in \mathbb{N}$ in a given simplicial complex by generalizing the node-based Generalized Haar-Walsh Transform (GHWT) and Hierarchical Graph Laplacian Eigen Transform (HGLET). The $\kappa$-GHWT and the $\kappa$-HGLET both form redundant sets (i.e., dictionaries) of multiscale basis vectors and the corresponding expansion coefficients of a given signal. Our MHSNs use a layered structure analogous to a convolutional neural network (CNN) to cascade the moments of the modulus of the dictionary coefficients. The resulting features are invariant to reordering of the simplices (i.e., node permutation of the underlying graphs). Importantly, the use of multiscale basis dictionaries in our MHSNs admits a natural pooling operation that is akin to local pooling in CNNs, and which may be performed either locally or per-scale. These pooling operations are harder to define in both traditional scattering networks based on Morlet wavelets, and geometric scattering networks based on Diffusion Wavelets. As a result, we are able to extract a rich set of descriptive yet robust features that can be used along with very simple machine learning methods (i.e., logistic regression or support vector machines) to achieve high-accuracy classification systems with far fewer parameters to train than most modern graph neural networks. Finally, we demonstrate the usefulness of our MHSNs in three distinct types of problems: signal classification, domain (i.e., graph/simplex) classification, and molecular dynamics prediction.

categories: cs.LG cs.NA cs.SI eess.SP math.NA stat.ML


title: Prompt Pool based Class-Incremental Continual Learning for Dialog State Tracking

abstract: Continual learning is crucial for dialog state tracking (DST) in dialog systems, since requirements from users for new functionalities are often encountered. However, most of existing continual learning methods for DST require task identities during testing, which is a severe limit in real-world applications. In this paper, we aim to address continual learning of DST in the class-incremental scenario (namely the task identity is unknown in testing). Inspired by the recently emerging prompt tuning method that performs well on dialog systems, we propose to use the prompt pool method, where we maintain a pool of key-value paired prompts and select prompts from the pool according to the distance between the dialog history and the prompt keys. The proposed method can automatically identify tasks and select appropriate prompts during testing. We conduct experiments on Schema-Guided Dialog dataset (SGD) and another dataset collected from a real-world dialog application. Experiment results show that the prompt pool method achieves much higher joint goal accuracy than the baseline. After combining with a rehearsal buffer, the model performance can be further improved.


title: Bi-Level Optimization to Enhance Intensity Modulated Radiation Therapy Planning

abstract: Intensity Modulated Radiation Therapy is an effective cancer treatment. Models based on the Generalized Equivalent Uniform Dose (gEUD) provide radiation plans with excellent planning target volume coverage and low radiation for organs at risk. However, manual adjustment of the parameters involved in gEUD is required to ensure that the plans meet patient-specific physical restrictions. This paper proposes a radiotherapy planning methodology based on bi-level optimization. We evaluated the proposed scheme in a real patient and compared the resulting irradiation plans with those prepared by clinical planners in hospital devices. The results in terms of efficiency and effectiveness are promising.


title: Improving FSM State Enumeration Performance for Hardware Security with RECUT and REFSM-SAT

abstract: Finite state machines (FSM's) are implemented with sequential circuits and are used to orchestrate the operation of hardware designs. Sequential obfuscation schemes aimed at preventing IP theft often operate by augmenting a design's FSM post-synthesis. Many such schemes are based on the ability to recover the FSM's topology from the synthesized design. In this paper, we present two tools which can improve the performance of topology extraction: RECUT, which extracts the FSM implementation from a netlist, and REFSM-SAT, which solves topology enumeration as a series of SAT problems. In some cases, these tools can improve performance significantly over current methods, attaining up to a 99\% decrease in runtime.


title: Radiative Majorana Neutrino Masses in a Parity Solution to the Strong CP Problem

abstract: The strong CP problem can be solved in Parity symmetric theories with electroweak gauge group containing $SU(2)_L \times SU(2)_R$ broken by the minimal Higgs content. Neutrino masses may be explained by adding the same number of gauge singlet fermions as the number of generations. The neutrino masses vanish at tree-level and are only radiatively generated, leading to larger couplings of right-handed neutrinos to Standard Model particles than with the tree-level seesaw mechanism. We compute these radiative corrections and the mixing angles between left- and right-handed neutrinos. We discuss sensitivities to these right-handed neutrinos from a variety of future experiments that search for heavy neutral leptons with masses from tens of MeV to the multi-TeV scale.