title: Binaural multichannel blind speaker separation with a causal low-latency and low-complexity approach

abstract: In this paper, we introduce a causal low-latency low-complexity approach for binaural multichannel blind speaker separation in noisy reverberant conditions. The model, referred to as Group Communication Binaural Filter and Sum Network (GCBFSnet) predicts complex filters for filter-and-sum beamforming in the time-frequency domain. We apply Group Communication (GC), i.e., latent model variables are split into groups and processed with a shared sequence model with the aim of reducing the complexity of a simple model only containing one convolutional and one recurrent module. With GC we are able to reduce the size of the model by up to 83 % and the complexity up to 73 % compared to the model without GC, while mostly retaining performance. Even for the smallest model configuration, GCBFSnet matches the performance of a low-complexity TasNet baseline in most metrics despite the larger size and higher number of required operations of the baseline.


title: High Absorptivity Nanotextured Powders for Additive Manufacturing

abstract: The widespread application of metal additive manufacturing (AM) is limited by the ability to control the complex interactions between the energy source and the feedstock material. Here we develop a generalizable process to introduce nanoscale grooves to the surface of metal powders which increases the powder absorptivity by up to 70% during laser powder bed fusion. Absorptivity enhancements in copper, copper-silver, and tungsten enables energy efficient manufacturing, with printing of pure copper at relative densities up to 92% using laser energy densities as low as 82 J/mm^3. Simulations show the enhanced powder absorptivity results from plasmon-enabled light concentration in nanoscale grooves combined with multiple scattering events. The approach taken here demonstrates a general method to enhance the absorptivity and printability of reflective and refractory metal powders by changing the surface morphology of the feedstock without altering its composition.


title: Herwig 7.3 Release Note

abstract: A new release of the Monte Carlo event generator Herwig (version 7.3) has been launched. This iteration encompasses several enhancements over its predecessor, version 7.2. Noteworthy upgrades include: the implementation of a process-independent electroweak angular-ordered parton shower integrated with QCD and QED radiation; a new recoil scheme for initial-state radiation improving the behaviour of the angular-ordered parton shower; the incorporation of the heavy quark effective theory to refine the hadronization and decay of excited heavy mesons and heavy baryons; a dynamic strategy to regulate the kinematic threshold of cluster splittings within the cluster hadronization model; several improvements to the structure of the cluster hadronization model allowing for refined models; the possibility to extract event-by-event hadronization corrections in a well-defined way; the possibility of using the string model, with a dedicated tune. Additionally, a new tuning of the parton shower and hadronization parameters has been executed. This article discusses the novel features introduced in version 7.3.0.


title: MRI Scan Synthesis Methods based on Clustering and Pix2Pix

abstract: We consider a missing data problem in the context of automatic segmentation methods for Magnetic Resonance Imaging (MRI) brain scans. Usually, automated MRI scan segmentation is based on multiple scans (e.g., T1-weighted, T2-weighted, T1CE, FLAIR). However, quite often a scan is blurry, missing or otherwise unusable. We investigate the question whether a missing scan can be synthesized. We exemplify that this is in principle possible by synthesizing a T2-weighted scan from a given T1-weighted scan. Our first aim is to compute a picture that resembles the missing scan closely, measured by average mean squared error (MSE). We develop/use several methods for this, including a random baseline approach, a clustering-based method and pixel-to-pixel translation method by Isola et al. (Pix2Pix) which is based on conditional GANs. The lowest MSE is achieved by our clustering-based method. Our second aim is to compare the methods with respect to the effect that using the synthesized scan has on the segmentation process. For this, we use a DeepMedic model trained with the four input scan modalities named above. We replace the T2-weighted scan by the synthesized picture and evaluate the segmentations with respect to the tumor identification, using Dice scores as numerical evaluation. The evaluation shows that the segmentation works well with synthesized scans (in particular, with Pix2Pix methods) in many cases.


title: Compressed baryon acoustic oscillation analysis is robust to modified-gravity models

abstract: We study the robustness of the baryon acoustic oscillation (BAO) analysis to the underlying cosmological model. We focus on testing the standard BAO analysis that relies on the use of a template. These templates are constructed assuming a fixed fiducial cosmological model and used to extract the location of the acoustic peaks. Such "compressed analysis" had been shown to be unbiased when applied to the $\Lambda$CDM model and some of its extensions. However, it has not been known whether this type of analysis introduces biases in a wider range of cosmological models where the template may not fully capture relevant features in the BAO signal. In this study, we apply the compressed analysis to noiseless mock power spectra that are based on Horndeski models, a broad class of modified-gravity theories specified with eight additional free parameters. We study the precision and accuracy of the BAO peak-location extraction assuming DESI, DESI II, and MegaMapper survey specifications. We find that the bias in the extracted peak locations is negligible; for example, it is less than 10% of the statistical error for even the proposed future MegaMapper survey. Our findings indicate that the compressed BAO analysis is remarkably robust to the underlying cosmological model.


title: Enhancing Single-Frame Supervision for Better Temporal Action Localization

abstract: Temporal action localization aims to identify the boundaries and categories of actions in videos, such as scoring a goal in a football match. Single-frame supervision has emerged as a labor-efficient way to train action localizers as it requires only one annotated frame per action. However, it often suffers from poor performance due to the lack of precise boundary annotations. To address this issue, we propose a visual analysis method that aligns similar actions and then propagates a few user-provided annotations (e.g. , boundaries, category labels) to similar actions via the generated alignments. Our method models the alignment between actions as a heaviest path problem and the annotation propagation as a quadratic optimization problem. As the automatically generated alignments may not accurately match the associated actions and could produce inaccurate localization results, we develop a storyline visualization to explain the localization results of actions and their alignments. This visualization facilitates users in correcting wrong localization results and misalignments. The corrections are then used to improve the localization results of other actions. The effectiveness of our method in improving localization performance is demonstrated through quantitative evaluation and a case study.


title: Video-Based Rendering Techniques: A Survey

abstract: Three-dimensional reconstruction of events recorded on images has been a common challenge between computer vision and computer graphics for a long time. Estimating the real position of objects and surfaces using vision as an input is no trivial task and has been approached in several different ways. Although huge progress has been made so far, there are several open issues to which an answer is needed. The use of videos as an input for a rendering process (video-based rendering, VBR) is something that recently has been started to be looked upon and has added many other challenges and also solutions to the classical image-based rendering issue (IBR). This article presents the state of art on video-based rendering and image-based techniques that can be applied on this scenario, evaluating the open issues yet to be solved, indicating where future work should be focused.


title: PathFinder: Guided Search over Multi-Step Reasoning Paths

abstract: With recent advancements in large language models, methods like chain-of-thought prompting to elicit reasoning chains have been shown to improve results on reasoning tasks. However, tasks that require multiple steps of reasoning still pose significant challenges to state-of-the-art models. Drawing inspiration from the beam search algorithm, we propose PathFinder, a tree-search-based reasoning path generation approach. It enhances diverse branching and multi-hop reasoning through the integration of dynamic decoding, enabled by varying sampling methods and parameters. Using constrained reasoning, PathFinder integrates novel quality constraints, pruning, and exploration methods to enhance the efficiency and the quality of generation. Moreover, it includes scoring and ranking features to improve candidate selection. Our approach outperforms competitive baselines on three complex arithmetic and commonsense reasoning tasks by 6% on average. Our model generalizes well to longer, unseen reasoning chains, reflecting similar complexities to beam search with large branching factors.


title: Tenplex: Dynamic Parallelism for Deep Learning using Parallelizable Tensor Collections

abstract: Deep learning (DL) jobs use multi-dimensional parallelism, i.e. combining data, model, and pipeline parallelism, to use large GPU clusters efficiently. Long-running jobs may experience changes to their GPU allocation: (i) resource elasticity during training adds or removes GPUs; (ii) hardware maintenance may require redeployment on different GPUs; and (iii) GPU failures force jobs to run with fewer devices. Current DL frameworks tie jobs to a set of GPUs and thus lack support for these scenarios. In particular, they cannot change the multi-dimensional parallelism of an already-running job in an efficient and model-independent way. We describe Scalai, a state management library for DL systems that enables jobs to change their parallelism dynamically after the GPU allocation is updated at runtime. Scalai achieves this through a new abstraction, a parallelizable tensor collection (PTC), that externalizes the job state during training. After a GPU change, Scalai uses the PTC to transform the job state: the PTC repartitions the dataset state under data parallelism and exposes it to DL workers through a virtual file system; and the PTC obtains the model state as partitioned checkpoints and transforms them to reflect the new parallelization configuration. For efficiency, Scalai executes PTC transformations in parallel with minimum data movement between workers. Our experiments show that Scalai enables DL jobs to support dynamic parallelization with low overhead.


title: Scaling properties of a random Yule tree embedded in $\mathbb{R}^{\mathfrak{D}}$

abstract: We study a random tree, which was introduced by Ajazi et al. as part of a model of a neuronal network. Realising a scaling relation for the law of the tree, we can use elementary techniques to derive asymptotic results on the geometry as time goes to infinity.


title: A Privacy-Preserving Framework for Cloud-Based HVAC Control

abstract: The objective of this work is (i) to develop an encrypted cloud-based HVAC control framework to ensure the privacy of occupancy information, (ii) to reduce the communication and computation costs of encrypted HVAC control. Occupancy of a building is sensitive and private information that can be accurately inferred by cloud-based HVAC controllers. To ensure the privacy of the privacy information, in our framework, the measurements of an HVAC system are encrypted by a fully homomorphic encryption prior to communication with the cloud controller. We first develop an encrypted fast gradient algorithm that allows the cloud controller to regulate the indoor temperature and CO$_2$ of a building by solving two model predictive control problems. We next develop an event-triggered control policy to reduce the communication and computation costs of the encrypted HVAC control. We cast the optimal design of the event-triggered policy as an optimal control problem wherein the objective is to minimize a linear combination of the control and communication costs. Using Bellman's optimality principle, we study the structural properties of the optimal event-triggered policy and show that the optimal triggering policy is a function of the current state, the last communicated state with the cloud, and the time since the last communication with the cloud. We also show that the optimal design of the event-triggered policy can be transformed into a Markov decision process by introducing two new states. We finally study the performance of the developed encrypted HVAC control framework using the TRNSYS simulator. Our numerical results show that the proposed framework not only ensures efficient control of the indoor temperature and CO$_2$ but also reduces the computation and communication costs of encrypted HVAC control by at least 60%.


title: LiteBIRD Science Goals and Forecasts: A full-sky measurement of gravitational lensing of the CMB

abstract: We explore the capability of measuring lensing signals in $LiteBIRD$ full-sky polarization maps. With a $30$ arcmin beam width and an impressively low polarization noise of $2.16\,\mu$K-arcmin, $LiteBIRD$ will be able to measure the full-sky polarization of the cosmic microwave background (CMB) very precisely. This unique sensitivity also enables the reconstruction of a nearly full-sky lensing map using only polarization data, even considering its limited capability to capture small-scale CMB anisotropies. In this paper, we investigate the ability to construct a full-sky lensing measurement in the presence of Galactic foregrounds, finding that several possible biases from Galactic foregrounds should be negligible after component separation by harmonic-space internal linear combination. We find that the signal-to-noise ratio of the lensing is approximately $40$ using only polarization data measured over $90\%$ of the sky. This achievement is comparable to $Planck$'s recent lensing measurement with both temperature and polarization and represents a four-fold improvement over $Planck$'s polarization-only lensing measurement. The $LiteBIRD$ lensing map will complement the $Planck$ lensing map and provide several opportunities for cross-correlation science, especially in the northern hemisphere.


title: AI Competitions and Benchmarks: Competition platforms

abstract: The ecosystem of artificial intelligence competitions is a diverse and multifaceted landscape, encompassing a variety of platforms that each host numerous competitions annually, alongside a plethora of specialized websites dedicated to singular contests. These platforms adeptly manage the overarching administrative responsibilities inherent in orchestrating competitions, thus affording organizers the liberty to allocate greater attention to other facets of their contests. Notably, these platforms exhibit considerable diversity in their operational functionalities, economic models, and community dynamics. This chapter conducts an extensive review of the foremost services in this realm and elucidates several alternative methodologies that facilitate the independent hosting of such challenges. Keywords: competition platform, challenge hosting services, comparison.


title: Nonlinear dynamics and emergent statistical regularity in classical Lennard-Jones three-body system upon disturbance

abstract: Understanding the deep connection of microscopic dynamics and statistical regularity yields insights into the foundation of statistical mechanics. In this work, based on the classical three-body system under the Lennard-Jones potential upon disturbance, we illustrated the elusive nonlinear dynamics in terms of the neat frequency-mixing processes, and revealed the emergent statistical regularity in speed distribution along a single particle trajectory. This work demonstrates the promising possibility of classical few-body models for exploring the fundamental questions on the interface of microscopic dynamics and statistical physics.


title: Seamless: Multilingual Expressive and Streaming Speech Translation

abstract: Large-scale automatic speech translation systems today lack key features that help machine-mediated communication feel seamless when compared to human-to-human dialogue. In this work, we introduce a family of models that enable end-to-end expressive and multilingual translations in a streaming fashion. First, we contribute an improved version of the massively multilingual and multimodal SeamlessM4T model-SeamlessM4T v2. This newer model, incorporating an updated UnitY2 framework, was trained on more low-resource language data. SeamlessM4T v2 provides the foundation on which our next two models are initiated. SeamlessExpressive enables translation that preserves vocal styles and prosody. Compared to previous efforts in expressive speech research, our work addresses certain underexplored aspects of prosody, such as speech rate and pauses, while also preserving the style of one's voice. As for SeamlessStreaming, our model leverages the Efficient Monotonic Multihead Attention mechanism to generate low-latency target translations without waiting for complete source utterances. As the first of its kind, SeamlessStreaming enables simultaneous speech-to-speech/text translation for multiple source and target languages. To ensure that our models can be used safely and responsibly, we implemented the first known red-teaming effort for multimodal machine translation, a system for the detection and mitigation of added toxicity, a systematic evaluation of gender bias, and an inaudible localized watermarking mechanism designed to dampen the impact of deepfakes. Consequently, we bring major components from SeamlessExpressive and SeamlessStreaming together to form Seamless, the first publicly available system that unlocks expressive cross-lingual communication in real-time. The contributions to this work are publicly released and accessible at https://github.com/facebookresearch/seamless_communication


title: Characterizing the Narrowband Ambiguity Function of Multi-Tone Sinusoidal Frequency Modulated Waveforms

abstract: This paper characterizes the mainlobe and sidelobe structure of the Multi-Tone Sinusoidal Frequency Modulated (MTSFM) transmit waveform's narrowband Ambiguity Function (AF) for active sonar applications. The MTSFM waveform's modulation function is represented as a Fourier series. The Fourier coefficients form a discrete set of parameters that are modified to synthesize waveforms with novel characteristics. The contour of the AF's mainlobe is well approximated as a coupled ellipse known as the Ellipse of Ambiguity (EOA). The EOA parameters determine whether a waveform is Doppler sensitive or Doppler tolerant. This paper derives exact closed form expressions for the EOA parameters of the MTSFM's AF. The MTSFM's design coefficients allow for fine control of its AF mainlobe width in range and Doppler as well as its RDCF. This fine control facilitates designing waveforms that can smoothly trade-off between possessing Doppler sensitive and Doppler tolerant characteristics. Additionally, this paper introduces a method to control the sidelobe structure of the MTSFM's Auto Correlation Function (ACF) while maintaining the waveform's AF mainlobe shape. This is achieved using a numerical optimization technique that minimizes the ratio of $\ell_2$-norms of the ACF mainlobe and sidelobe regions subject to constraints on the EOA parameters. Simulations demonstrate the effectiveness of this optimization technique.


title: Distributed Autonomous Organizations as Public Services Supplying Platform

abstract: Servizi Elaborazioni Dati SpA is a public company owned by Municipality of L Aquila, it supplies the institution with network services and software applications for distributing services to citizens. The future policy of the company is to enlarge the offer of its services to nearby communities that are unable to set up and maintain their own network and software structures. This paper presents thus a possible architecture model to support small municipalities in supplying public services to citizens, with the aid of SED Spa. Through second level platforms based on Blockchain networks and Multi-agents Systems running on smart contracts, the system will focus on Waste Tax (Ta.Ri) management system in the Fascicolo del Cittadino environment.


title: Fine Dense Alignment of Image Bursts through Camera Pose and Depth Estimation

abstract: This paper introduces a novel approach to the fine alignment of images in a burst captured by a handheld camera. In contrast to traditional techniques that estimate two-dimensional transformations between frame pairs or rely on discrete correspondences, the proposed algorithm establishes dense correspondences by optimizing both the camera motion and surface depth and orientation at every pixel. This approach improves alignment, particularly in scenarios with parallax challenges. Extensive experiments with synthetic bursts featuring small and even tiny baselines demonstrate that it outperforms the best optical flow methods available today in this setting, without requiring any training. Beyond enhanced alignment, our method opens avenues for tasks beyond simple image restoration, such as depth estimation and 3D reconstruction, as supported by promising preliminary results. This positions our approach as a versatile tool for various burst image processing applications.


title: First GMVA observations with the upgraded NOEMA facility: VLBI imaging of BL Lacertae in a flaring state

abstract: We analyze a single-epoch Global mm-VLBI Array (GMVA) observation of the blazar BL Lacertae (BL Lac) at 86 GHz from April 2021. The participation of the upgraded, phased Northern Extended Millimetre Array (NOEMA) adds additional sensitivity to the GMVA, which has facilitated the imaging of BL Lac during an unprecedentedly strong $\gamma$-ray flare. We aim to explore the nature of the inner subparsec jet of BL Lac and the impact of the NOEMA participation in the observation. For the data reduction, we employed two advanced automatic pipelines: rPICARD for the flux density calibration as well as the model-agnostic signal stabilization and GPCAL for the antenna leakage calibration. The conventional hybrid imaging (CLEAN + amplitude and phase self-calibration) was applied to the calibrated visibilities to generate final VLBI images. We performed a ridge-line analysis and Gaussian model-fits on the final jet image to derive the jet parameters. In our data, the presence of NOEMA improves the image sensitivity by a factor of 2.5. The jet shows a clear wiggling structure within 0.4 mas from the core. Our ridge-line analysis suggests the presence of a helical jet structure (i.e., a sinusoidal pattern). Six circular Gaussian components were fitted to the inner jet region. We estimated an apparent brightness temperature of $\sim$3 $\times$ 10$^{12}$ K in the two innermost components. They are likely to be highly boosted by relativistic beaming effect. We find four significant polarized knots in the jet. Interestingly, two of them are located in the core region. Finally, we suggest a number of physical scenarios to interpret our results.


title: Force Matching and Iterative Boltzmann Inversion Coarse Grained Force Fields for ZIF-8

abstract: Despite the intense activity at the electronic and atomistic resolutions, coarse grained (CG) modeling of MOFs remains largely unexplored. One of the main reasons for this is the lack of adequate CG force fields. In this work, we present Iterative Boltzmann Inversion (IBI) and Force Matching (FM) force fields for modeling ZIF-8 in three different coarse grained resolutions. Their ability of reproducing structure, elastic tensor and thermal expansion is evaluated and compared with that of MARTINI force-fields considered in previous work.[C. M. S. Alvares et al, J. Chem. Phys., 158, 194107 (2023).] Moreover, MARTINI and FM are evaluated in their ability of depicting the swing effect, a subtle phase transition ZIF-8 undergoes when loaded with guest molecules. Overall, we found that all our force fields reproduce structure reasonably well. Elastic constants and volume expansion results are analyzed and the technical and conceptual challenges in reproducing them are explained. Force matching exhibits promising results for capturing the swing effect. This is the first time these CG methods, widely applied in polymer and biomolecules communities, are deployed to model porous solids. We highlight the challenges of fitting CG force fields for these materials. This work opens the door to a whole new line of developments in the field of modeling MOFs and other porous crystalline solids.


title: Gravitational $p \to \Delta^+ $ transition form factors in chiral perturbation theory

abstract: The gravitational form factors of the transition from the proton to the $\Delta^+$ resonance are calculated to leading one-loop order using a manifestly Lorentz-invariant formulation of chiral perturbation theory. We take into account the leading electromagnetic and strong isospin-violating effects. The loop contributions to the transition form factors are found to be free of power-counting violating pieces, which is consistent with the absence of tree-level diagrams at the considered order. In this sense, our results can be regarded as predictions of chiral perturbation theory.


title: LiteBIRD Science Goals and Forecasts: Improving Sensitivity to Inflationary Gravitational Waves with Multitracer Delensing

abstract: We estimate the efficiency of mitigating the lensing $B$-mode polarization, the so-called delensing, for the $LiteBIRD$ experiment with multiple external data sets of lensing-mass tracers. The current best bound on the tensor-to-scalar ratio, $r$, is limited by lensing rather than Galactic foregrounds. Delensing will be a critical step to improve sensitivity to $r$ as measurements of $r$ become more and more limited by lensing. In this paper, we extend the analysis of the recent $LiteBIRD$ forecast paper to include multiple mass tracers, i.e., the CMB lensing maps from $LiteBIRD$ and CMB-S4-like experiment, cosmic infrared background, and galaxy number density from $Euclid$- and LSST-like survey. We find that multi-tracer delensing will further improve the constraint on $r$ by about $20\%$. In $LiteBIRD$, the residual Galactic foregrounds also significantly contribute to uncertainties of the $B$-modes, and delensing becomes more important if the residual foregrounds are further reduced by an improved component separation method.


title: Conformal Prediction in Multi-User Settings: An Evaluation

abstract: Typically, machine learning models are trained and evaluated without making any distinction between users (e.g, using traditional hold-out and cross-validation). However, this produces inaccurate performance metrics estimates in multi-user settings. That is, situations where the data were collected by multiple users with different characteristics (e.g., age, gender, height, etc.) which is very common in user computer interaction and medical applications. For these types of scenarios model evaluation strategies that provide better performance estimates have been proposed such as mixed, user-independent, user-dependent, and user-adaptive models. Although those strategies are better suited for multi-user systems, they are typically assessed with respect to performance metrics that capture the overall behavior of the models and do not provide any performance guarantees for individual predictions nor they provide any feedback about the predictions' uncertainty. In order to overcome those limitations, in this work we evaluated the conformal prediction framework in several multi-user settings. Conformal prediction is a model agnostic method that provides confidence guarantees on the predictions, thus, increasing the trustworthiness and robustness of the models. We conducted extensive experiments using different evaluation strategies and found significant differences in terms of conformal performance measures. We also proposed several visualizations based on matrices, graphs, and charts that capture different aspects of the resulting prediction sets.


title: Magnetic Order and Magnetic Excitations in FeTe: How Good is a Short-Range Heisenberg Model?

abstract: We revisit the fitting of the Fang-Bernevig-Hu model [Europhys. Lett. 86, 67005 (2009)] to inelastic neutron scattering data carried out by Lipscombe et al. [Phys. Rev. Lett. 106, 057004 (2011)]. We demonstrate that there are many quite different parameter choices within the experimentally observed phase (AFM3) that provide approximately equally good fits to the neutron data. We note that (a) all of these parameter sets lie very close to a point of transition between the AFM3 phase and one of its neighbors in the classical phase diagram, and (b) many of them involve rather large values of the third-neighbor coupling $J_3$. In light of these observations, we discuss whether the modeling of FeTe may need revision to allow for a slightly non-AFM3 ground state, orbital as well as spin physics on the Fe sites, the effects of electron itinerancy, or a combination of these.


title: On a Theorem by Lin and Shinder through the Lens of Median Geometry

abstract: Recently, Lin and Shinder constructed non-trivial homomorphisms from Cremona groups of rank >2 to \mathbb{Z} using motivic techniques. In this short note we propose an alternative perspective from median geometry on their theorem.


title: Fluidic FlowBots: Intelligence embodied in the characteristics of recirculating fluid flow

abstract: The one-to-one mapping of control inputs to actuator outputs results in elaborate routing architectures that limit how complex fluidic soft robot behaviours can currently become. Embodied intelligence can be used as a tool to counteract this phenomenon. Control functionality can be embedded directly into actuators by leveraging the characteristics of fluid flow phenomena. Whilst prior soft robotics work has focused exclusively on actuators operating in a state of transient/no flow (constant pressure), or pulsatile/alternating flow, our work begins to explore the possibilities granted by operating in the closed-loop flow recirculation regime. Here we introduce the concept of FlowBots: soft robots that utilise the characteristics of continuous fluid flow to enable the embodiment of complex control functionality directly into the structure of the robot. FlowBots have robust, integrated, no-moving-part control systems, and these architectures enable: monolithic additive manufacturing methods, rapid prototyping, greater sustainability, and an expansive range of applications. Based on three FlowBot examples: a bidirectional actuator, a gripper, and a quadruped swimmer - we demonstrate how the characteristics of flow recirculation contribute to simplifications in fluidic analogue control architectures. We conclude by outlining our design and rapid prototyping methodology to empower others in the field to explore this new, emerging design field, and design their own FlowBots.


title: Low-Temperature Multi-Mode Microwave Spectroscopy of Paramagnetic and Rare-Earth Ion Spin Impurities in Single Crystal Calcium Tungstate

abstract: We present experimental observations of dilute ion spin ensembles in an undoped low-loss single crystal cylindrical sample of CaWO$_4$ cooled to 30 mK in temperature. Crystal field perturbations were elucidated by constructing a dielectrically loaded microwave cavity resonator from the crystal. The resonator exhibited numerous whispering gallery modes with high Q-factors of up to $3\times 10^7$, equivalent to a low loss tangent of $\sim 3\times 10^{-8}$. The low-loss allowed precision multi-mode spectroscopy of numerous high Q-factor photon\hyp{}spin interactions. Measurements between 7 to 22 GHz revealed the presence of Gd$^{3+}$, Fe$^{3+}$, and another trace species, inferred to be rare\hyp{}earth, at concentrations on the order of parts per billion. These findings motivate further exploration of prospective uses of this low-loss dielectric material for applications regarding precision and quantum metrology, as well as tests for beyond standard model physics.


title: DelucionQA: Detecting Hallucinations in Domain-specific Question Answering

abstract: Hallucination is a well-known phenomenon in text generated by large language models (LLMs). The existence of hallucinatory responses is found in almost all application scenarios e.g., summarization, question-answering (QA) etc. For applications requiring high reliability (e.g., customer-facing assistants), the potential existence of hallucination in LLM-generated text is a critical problem. The amount of hallucination can be reduced by leveraging information retrieval to provide relevant background information to the LLM. However, LLMs can still generate hallucinatory content for various reasons (e.g., prioritizing its parametric knowledge over the context, failure to capture the relevant information from the context, etc.). Detecting hallucinations through automated methods is thus paramount. To facilitate research in this direction, we introduce a sophisticated dataset, DelucionQA, that captures hallucinations made by retrieval-augmented LLMs for a domain-specific QA task. Furthermore, we propose a set of hallucination detection methods to serve as baselines for future works from the research community. Analysis and case study are also provided to share valuable insights on hallucination phenomena in the target scenario.


title: Embedding theory in ML toward real-time tracking of structural dynamics through hyperspectral datasets

abstract: In-situ Electron Energy Loss Spectroscopy (EELS) is an instrumental technique that has traditionally been used to understand how the choice of materials processing has the ability to change local structure and composition. However, more recent advances to observe and react to transient changes occurring at the ultrafast timescales that are now possible with EELS and Transmission Electron Microscopy (TEM) will require new frameworks for characterization and analysis. We describe a machine learning (ML) framework for the rapid assessment and characterization of in operando EELS Spectrum Images (EELS-SI) without the need for many labeled training datapoints as typically required for deep learning classification methods. By embedding computationally generated structures and experimental datasets into an equivalent latent space through Variational Autoencoders (VAE), we effectively predict the structural changes at latency scales relevant to closed-loop processing within the TEM. The framework described in this study is a critical step in enabling automated, on-the-fly synthesis and characterization which will greatly advance capabilities for materials discovery and precision engineering of functional materials at the atomic scale.


title: Emergent Time and Time Travel in Quantum Physics

abstract: Entertaining the possibility of time travel will invariably challenge dearly held concepts of fundamental physics. It becomes relatively easy to construct multiple logical contradictions using differing starting points from various well-established fields of physics. Sometimes, the interpretation is that only a full theory of quantum gravity will be able to settle these logical contradictions. Even then, it remains unclear if the multitude of problems could be overcome. Yet as definitive as this seems to the notion of time travel in physics, such a recourse to quantum gravity comes with its own, long-standing challenge to most of these counter-arguments to time travel: These arguments rely on time, while quantum gravity is (in)famously stuck with and dealing with the problem of time. One attempt to answer this problem within the canonical framework resulted in the Page-Wootters formalism, and its recent gauge-theoretic re-interpretation - as an emergent notion of time. Herein, we will begin a programme to study toy models implementing the Hamiltonian constraint in quantum theory, with an aim towards understanding what an emergent notion of time can tell us about the (im)possibility of time travel.


title: Non-Relativistic Quantum Chromodynamics in Parton Showers

abstract: Measurements of quarkonia isolation in jets at the Large Hadron Collider (LHC) have been shown to disagree with fixed-order non-relativistic quantum chromodynamics (NRQCD) calculations, even at higher orders. Calculations using the fragmenting jet function formalism are able to better describe data but cannot provide full event-level predictions. In this work we provide an alternative model via NRQCD production of quarkonia in a timelike parton shower. We include this model in the Pythia 8 event generator and validate our parton-shower implementation against analytic forms of the relevant fragmentation functions. Finally, we make inclusive predictions of quarkonia production for the decay of the standard-model Higgs boson.


title: Stoichiometry preservation and generalization of Bilger mixture fraction for non-premixed combustion with differential molecular diffusion

abstract: The Bilger mixture fraction is a widely used parameter in non-premixed combustion when considering differential molecular diffusion, a prevalent phenomenon in hydrogen or hydrogen-blended fuel combustion. The property of stoichiometry preservation of mixture fractions is investigated. Two different Bilger mixture fraction formulations are clarified. It is found that they belong to a class of one-parameter generalized mixture fraction definitions discovered in this work. Specific definitions from the class of mixture fractions are compared for hydrocarbon fuels. The comparison shows that the difference can be significant. An optimal mixture fraction definition is sought from the general definitions by minimizing its deviation from the desired properties. The obtained optimal mixture fractions show overall better preservation of stoichiometry than Bilger's definitions. The extension of the generalized mixture fraction to other fuels that contain nitrogen (like ammonia $\mathrm{NH_3}$) or sulfur (like hydrogen sulfide $\mathrm{H_2S}$) is also demonstrated.


title: Closed-Loop Electron-Beam-Induced Spectroscopy and Nanofabrication Around Individual Quantum Emitters

abstract: Color centers in diamond play a central role in the development of quantum photonic technologies, and their importance is only expected to grow in the near future. For many quantum applications, high collection efficiency from individual emitters is required, but the refractive index mismatch between diamond and air limits the optimal collection efficiency with conventional diamond device geometries. While different out-coupling methods with near-unity efficiency exist, many have yet to be realized due to current limitations in nanofabrication methods, especially for mechanically hard materials like diamond. Here, we leverage electron-beam-induced etching to modify Sn-implanted diamond quantum microchiplets containing integrated waveguides with width and thickness of 280 nm and 200 nm, respectively. This approach allows for simultaneous high-resolution imaging and modification of the host matrix with an open geometry and direct writing. When coupled with the cathodoluminescence signal generated from the electron-emitter interactions, we can monitor the enhancement of the quantum emitters in real-time with nanoscale spatial resolution. The operando measurement and manipulation of single photon emitters demonstrated here provides a new foundation for the control of emitter-cavity interactions in integrated quantum photonics.


title: Anomalous Dimensions via on-shell Methods: Operator Mixing and Leading Mass Effects

abstract: We elaborate on the application of on-shell and unitarity-based methods for evaluating renormalization group coefficients, and generalize this framework to account for the mixing of operators with different dimensions and leading mass effects. We derive a master formula for anomalous dimensions stemming from the general structure of operator mixings, up to two-loop order, and show how the Higgs low-energy theorem can be exploited to include leading mass effects. A few applications on the renormalization properties of popular effective field theories showcase the strength of the proposed approach, which drastically reduces the complexity of standard loop calculations. Our results provide a powerful tool to interpret experimental measurements of low-energy observables, such as flavor violating processes or electric and magnetic dipole moments, as induced by new physics emerging above the electroweak scale.


title: Endorsing black holes with beyond Horndeski primary hair: An exact solution framework for scalarizing in every dimension

abstract: This work outlines a straightforward mechanism for endorsing primary hair into Schwarzschild black holes, resulting in a unique modification within the framework of a special scalar-tensor theory, the so-called beyond Horndeski type. The derived solutions are exact, showcase primary hair with an everywhere regular scalar field profile, and continuously connect with the vacuum geometry. Initially devised to introduce primary hair in spherically symmetric solutions within General Relativity in any dimension, our investigation also explores the conditions under which spherically symmetric black holes in alternative gravitational theories become amenable to the endorsement of primary hair through a similar pattern. As a preliminary exploration, we embark on the process of endorsing primary hair to the Reissner-Nordstr\"om black hole. Subsequently, we extend our analysis to encompass spherically symmetric solutions within Lovelock and cubic quasitopological gravity theories.


title: ControlRoom3D: Room Generation using Semantic Proxy Rooms

abstract: Manually creating 3D environments for AR/VR applications is a complex process requiring expert knowledge in 3D modeling software. Pioneering works facilitate this process by generating room meshes conditioned on textual style descriptions. Yet, many of these automatically generated 3D meshes do not adhere to typical room layouts, compromising their plausibility, e.g., by placing several beds in one bedroom. To address these challenges, we present ControlRoom3D, a novel method to generate high-quality room meshes. Central to our approach is a user-defined 3D semantic proxy room that outlines a rough room layout based on semantic bounding boxes and a textual description of the overall room style. Our key insight is that when rendered to 2D, this 3D representation provides valuable geometric and semantic information to control powerful 2D models to generate 3D consistent textures and geometry that aligns well with the proxy room. Backed up by an extensive study including quantitative metrics and qualitative user evaluations, our method generates diverse and globally plausible 3D room meshes, thus empowering users to design 3D rooms effortlessly without specialized knowledge.


title: HALO: An Ontology for Representing and Categorizing Hallucinations in Large Language Models

abstract: Recent progress in generative AI, including large language models (LLMs) like ChatGPT, has opened up significant opportunities in fields ranging from natural language processing to knowledge discovery and data mining. However, there is also a growing awareness that the models can be prone to problems such as making information up or `hallucinations', and faulty reasoning on seemingly simple problems. Because of the popularity of models like ChatGPT, both academic scholars and citizen scientists have documented hallucinations of several different types and severity. Despite this body of work, a formal model for describing and representing these hallucinations (with relevant meta-data) at a fine-grained level, is still lacking. In this paper, we address this gap by presenting the Hallucination Ontology or HALO, a formal, extensible ontology written in OWL that currently offers support for six different types of hallucinations known to arise in LLMs, along with support for provenance and experimental metadata. We also collect and publish a dataset containing hallucinations that we inductively gathered across multiple independent Web sources, and show that HALO can be successfully used to model this dataset and answer competency questions.


title: IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray Tracing

abstract: We present IntrinsicAvatar, a novel approach to recovering the intrinsic properties of clothed human avatars including geometry, albedo, material, and environment lighting from only monocular videos. Recent advancements in human-based neural rendering have enabled high-quality geometry and appearance reconstruction of clothed humans from just monocular videos. However, these methods bake intrinsic properties such as albedo, material, and environment lighting into a single entangled neural representation. On the other hand, only a handful of works tackle the problem of estimating geometry and disentangled appearance properties of clothed humans from monocular videos. They usually achieve limited quality and disentanglement due to approximations of secondary shading effects via learned MLPs. In this work, we propose to model secondary shading effects explicitly via Monte-Carlo ray tracing. We model the rendering process of clothed humans as a volumetric scattering process, and combine ray tracing with body articulation. Our approach can recover high-quality geometry, albedo, material, and lighting properties of clothed humans from a single monocular video, without requiring supervised pre-training using ground truth materials. Furthermore, since we explicitly model the volumetric scattering process and ray tracing, our model naturally generalizes to novel poses, enabling animation of the reconstructed avatar in novel lighting conditions.


title: Structural, dielectric and energy storage properties of BaO-Na2O-Nb2O5-P2O5 glass-ceramic

abstract: A series of (1-x)[(2BaO-0,5Na2O)-1P2O5] -xNb2O5 (BNPN, x=0,41, 0,43, 0,45, 0,48) glass-ceramics based on phosphate glasses have been prepared via a controlled-crystallization route. The structure, dielectric properties, interfacial polarization, and energy storage properties were systematically investigated. The x-ray diffraction results showed the simultaneous presence of Ba2NaNb5O15 tungsten bronze structure (TTB) and the NaNbO3 perovskite. A stable dielectric constant over a temperature range from 25-200{\deg}C, low dielectric losses less than 0,03, and excellent frequency stability at room temperature were obtained. The decrease in niobium content promoted TTB crystallization with the improvement of the high dielectric properties of the system. The optimum of the dielectric constant and recoverable energy storage density were obtained for BNP41 crystallized at 1000{\deg}C. Analyses of the complex impedance indicated that the niobium content and crystallization temperature affect the interfacial polarization.


title: Enabling Normally-off In-Situ Computing with a Magneto-Electric FET-based SRAM Design

abstract: As an emerging post-CMOS Field Effect Transistor, Magneto-Electric FETs (MEFETs) offer compelling design characteristics for logic and memory applications, such as high-speed switching, low power consumption, and non-volatility. In this paper, for the first time, a non-volatile MEFET-based SRAM design named ME-SRAM is proposed for edge applications which can remarkably save the SRAM static power consumption in the idle state through a fast backup-restore process. To enable normally-off in-situ computing, the ME-SRAM cell is integrated into a novel processing-in-SRAM architecture that exploits a hardware-optimized bit-line computing approach for the execution of Boolean logic operations between operands housed in a memory sub-array within a single clock cycle. Our device-to-architecture evaluation results on Binary convolutional neural network acceleration show the robust performance of ME- SRAM while reducing energy consumption on average by a factor of 5.3 times compared to the best in-SRAM designs.


title: Achieving Consensus on Spectrum Usage in the Presence of Faults

abstract: A consensus mechanism is proposed to facilitate radio spectrum sharing with accountability in a network of multiple operators, a subset of which may even be adversarial. A distributed ledger is used to securely record and keep track of the state of consensus on spectrum usage, including interference incidents and the corresponding responsible parties. A key challenge is that the operators generally do not have initial agreement due to noise in their analog measurements. To meet this challenge, two categories of spectrum-sharing solutions are studied in detail. The first category employs an exact Byzantine fault tolerant (BFT) agreement model; the second category utilizes an approximate BFT agreement model. This paper also delves into the application of consensus protocols to the specific context of low Earth orbit (LEO) non-geostationary satellite networks, also known as mega-constellations.


title: Boosting Resonant Sensing in Fluids: A Surprising Discovery

abstract: Micro-mechanical resonators are widely used in modern sensing technology due to their high quality-factor (Q), enabling sensitive detection of various stimuli. However, the performance of these resonators in fluid environments is limited by significant viscous and acoustic radiation losses that reduce their Q. Here, we present a paradigm-shifting discovery that challenges the conventional wisdom of resonant sensing in fluids. We report an optimal volume of fluid over a 2D micro-resonator that increases the Q by up to 1000% compared to that in air. We have conducted precise experiments on piezoelectric, circular, membrane-type micro-resonators of 4 mm diameter fabricated using MEMS technology on silicon-on-insulator (SOI) wafers. The top side of the resonator was filled with different volumes of fluid and its Q was measured through resonance tracking by actuating the resonator with an appropriate voltage. We found the existence of an optimal volume of fluid that maximized the Q. We argue that this phenomenon is a result of a balance between the enhancement of kinetic energy of the resonator due to mass loading of the fluid and the energy dissipation through viscous and acoustic radiation losses in the fluid medium. This remarkable enhancement in Q substantially improves the sensitivity of the resonator, with important implications for diverse applications such as biosensing, chemical detection, and environmental monitoring. Our findings challenge the prevailing understanding of resonant sensing in fluids and open up new avenues for the development of highly sensitive and accurate sensors.


title: DeltaZip: Multi-Tenant Language Model Serving via Delta Compression

abstract: Fine-tuning large language models (LLMs) for downstream tasks can greatly improve model quality, however serving many different fine-tuned LLMs concurrently for users in multi-tenant environments is challenging. Dedicating GPU memory for each model is prohibitively expensive and naively swapping large model weights in and out of GPU memory is slow. Our key insight is that fine-tuned models can be quickly swapped in and out of GPU memory by extracting and compressing the delta between each model and its pre-trained base model. We propose DeltaZip, an LLM serving system that efficiently serves multiple full-parameter fine-tuned models concurrently by aggressively compressing model deltas by a factor of $6\times$ to $8\times$ while maintaining high model quality. DeltaZip increases serving throughput by $1.5\times$ to $3\times$ and improves SLO attainment compared to a vanilla HuggingFace serving system.


title: Kinetic-Ballooning-Bifurcation in Tokamak Pedestals Across Shaping and Aspect-Ratio

abstract: We use a new gyrokinetic threshold model to predict a bifurcation in tokamak pedestal width-height scalings that depends strongly on plasma shaping and aspect-ratio. The bifurcation arises from the first and second stability properties of kinetic-ballooning-modes that yields wide and narrow pedestal branches, expanding the space of accessible pedestal widths and heights. The wide branch offers potential for edge-localized-mode-free pedestals with high core pressure. For negative triangularity, low-aspect-ratio configurations are predicted to give steeper pedestals than conventional-aspect-ratio. Both wide and narrow branches have been attained in tokamak experiments.


title: First-order, continuous, and multicritical Bose-Einstein condensation in Bose mixtures

abstract: We address the possibility of realizing Bose-Einstein condensation as a first-order phase transition by admixture of particles of different species. To this aim we perform a comprehensive analysis of phase diagrams of two-component mixtures of bosons at finite temperatures. As a prototype model, we analyze a binary mixture of Bose particles interacting via an infinite-range (Kac-scaled) two-body potential. We obtain a rich phase diagram, where the transition between the normal and Bose-Einstein condensed phases may be either continuous or first-order. The phase diagram hosts lines of triple points, tricritical points, as well as quadruple points. We address the structure of the phase diagram depending on the relative magnitudes of the inter- and intra-species interaction couplings. In addition, even for purely repulsive interactions, we identify a first-order liquid-gas type transition between non-condensed phases characterized by different particle concentrations. In the obtained phase diagram, a surface of such first-order transitions terminates with a line of critical points.


title: Fast and robust cat state preparation utilizing higher order nonlinearities

abstract: Cat states are a valuable resource for quantum metrology applications, promising to enable sensitivity down to the Heisenberg limit. Moreover, Schr\"odinger cat states, based on a coherent superposition of coherent states, show robustness against phase-flip errors making them a promising candidate for bosonic quantum codes. A pathway to realize cat states is via utilizing single Kerr-type anharmonicities as found in superconducting devices as well as in Rydberg atoms. Such platforms nevertheless utilize only the second order anharmonicity, which limits the time it takes for a cat state to be prepared. Here we show how proper tuning of multiple higher order nonlinear interactions leads to shorter cat state preparation time. We also discuss practical aspects including an optimal control scheme which allows us to start the state preparation from the vacuum state under standard single mode driving. Lastly, we propose an ensemble of Rydberg atoms that exhibits higher order nonlinearities as a platform to prepare cat states in the laboratory.


title: Enhancing Facial Classification and Recognition using 3D Facial Models and Deep Learning

abstract: Accurate analysis and classification of facial attributes are essential in various applications, from human-computer interaction to security systems. In this work, a novel approach to enhance facial classification and recognition tasks through the integration of 3D facial models with deep learning methods was proposed. We extract the most useful information for various tasks using the 3D Facial Model, leading to improved classification accuracy. Combining 3D facial insights with ResNet architecture, our approach achieves notable results: 100% individual classification, 95.4% gender classification, and 83.5% expression classification accuracy. This method holds promise for advancing facial analysis and recognition research.


title: Shape Matters: Detecting Vertebral Fractures Using Differentiable Point-Based Shape Decoding

abstract: Degenerative spinal pathologies are highly prevalent among the elderly population. Timely diagnosis of osteoporotic fractures and other degenerative deformities facilitates proactive measures to mitigate the risk of severe back pain and disability. In this study, we specifically explore the use of shape auto-encoders for vertebrae, taking advantage of advancements in automated multi-label segmentation and the availability of large datasets for unsupervised learning. Our shape auto-encoders are trained on a large set of vertebrae surface patches, leveraging the vast amount of available data for vertebra segmentation. This addresses the label scarcity problem faced when learning shape information of vertebrae from image intensities. Based on the learned shape features we train an MLP to detect vertebral body fractures. Using segmentation masks that were automatically generated using the TotalSegmentator, our proposed method achieves an AUC of 0.901 on the VerSe19 testset. This outperforms image-based and surface-based end-to-end trained models. Additionally, our results demonstrate that pre-training the models in an unsupervised manner enhances geometric methods like PointNet and DGCNN. Our findings emphasise the advantages of explicitly learning shape features for diagnosing osteoporotic vertebrae fractures. This approach improves the reliability of classification results and reduces the need for annotated labels. This study provides novel insights into the effectiveness of various encoder-decoder models for shape analysis of vertebrae and proposes a new decoder architecture: the point-based shape decoder.


title: Analytic bootstrap for magnetic impurities

abstract: We study the $O(3)$ critical model and the free theory of a scalar triplet in the presence of a magnetic impurity. We use analytic bootstrap techniques to extract results in the $\varepsilon$-expansion. First, we extend by one order in perturbation theory the computation of the beta function for the defect coupling in the free theory. Then, we analyze in detail the low-lying spectrum of defect operators, focusing on their perturbative realization when the defect is constructed as a path-ordered exponential. After this, we consider two different bulk two-point functions and we compute them using the defect dispersion relation. For a free bulk theory, we are able to fix the form of the correlator at all orders in $\varepsilon$. In particular, taking $\varepsilon\to1$, we can show that in $d=3$ one does not have a consistent and non-trivial defect CFT. For an interacting bulk, we compute the correlator up to second order in $\varepsilon$. Expanding these results in the bulk and defect block expansions, we are able to extract an infinite set of defect CFT data. We discuss low-spin ambiguities that affect every result computed through the dispersion relation and we use a combination of consistency conditions and explicit diagrammatic calculations to fix this ambiguity.


title: Efficient evaluation of joint pdf of a L\'evy process, its extremum, and hitting time of the extremum

abstract: For L\'evy processes with exponentially decaying tails of the L\'evy density, we derive integral representations for the joint cpdf $V$ of $(X_T, \bar X_T,\tau_T)$ (the process, its supremum evaluated at $T<+\infty$, and the first time at which $X$ attains its supremum). The first representation is a Riemann-Stieltjes integral in terms of the (cumulative) probability distribution of the supremum process and joint probability distribution function of the process and its supremum process. The integral is evaluated using a combination an analog of the trapezoid rule. The second representation is amenable to more accurate albeit slower calculations. We calculate explicitly the Laplace-Fourier transform of $V$ w.r.t. all arguments, apply the inverse transforms, and reduce the problem to evaluation of the sum of 5D integrals. The integrals can be evaluated using the summation by parts in the infinite trapezoid rule and simplified trapezoid rule; the inverse Laplace transforms can be calculated using the Gaver-Wynn-Rho algorithm. Under additional conditions on the domain of analyticity of the characteristic exponent, the speed of calculations is greatly increased using the conformal deformation technique. For processes of infinite variation, the program in Matlab running on a Mac with moderate characteristics achieves the precision better than E-05 in a fraction of a second; the precision better than E-10 is achievable in dozens of seconds. As the order of the process (the analog of the Blumenthal-Getoor index) decreases, the CPU time increases, and the best accuracy achievable with double precision arithmetic decreases.


title: Discriminating Majorana and Dirac heavy neutrinos at lepton colliders

abstract: In this paper we investigate how well the nature of heavy neutral leptons can be determined at a future lepton collider, after its potential discovery. Considered in a simplified model are prompt decays of the neutrino in the mass range from 100 GeV to 10 TeV. We study event selection and application of multivariate analyses to determine whether such a newly discovered particle is of the Dirac or Majorana nature. Combining lepton charge and kinematic event variables, we find that the nature of a heavy neutrino, whether it is a Dirac or a Majorana particle, can be determined at 95% C.L. almost in the whole discovery range. We will briefly speculate about other than the studied channels and the robustness of this statement in more general models of heavy neutral leptons, particularly on the complementarity of high-energy electron-positron vs. muon colliders on resolving the flavor structure of heavy neutrinos.


title: Poincar\'e Duality for Supermanifolds, Higher Cartan Structures and Geometric Supergravity

abstract: We study relative differential and integral forms and their cohomology on families of supermanifolds and prove a relative version of Poincar\'e duality relating the cohomology of differential and integral forms in different geometric categories. In the smooth category, we complement Poincar\'e duality by proving the compactly supported Poincar\'e lemmas for both differential and integral forms, filling a gap in the literature. We then use our results to study supergravity. In particular, we describe supergravity in dimension three via higher Cartan structures, which can be regarded as certain classes of connections taking values in $L_\infty$-superalgebras. We then use relative Poincar\'e duality to state a general form of the action principle in a mathematically rigorous manner. This interpolates in a unified fashion between two equivalent formulations of supergravity, one based on the superspace approach and the other on the group manifold approach in the physics literature.

categories: math-ph gr-qc hep-th math.AG math.DG math.MP


title: Neural Spectral Methods: Self-supervised learning in the spectral domain

abstract: We present Neural Spectral Methods, a technique to solve parametric Partial Differential Equations (PDEs), grounded in classical spectral methods. Our method uses orthogonal bases to learn PDE solutions as mappings between spectral coefficients. In contrast to current machine learning approaches which enforce PDE constraints by minimizing the numerical quadrature of the residuals in the spatiotemporal domain, we leverage Parseval's identity and introduce a new training strategy through a \textit{spectral loss}. Our spectral loss enables more efficient differentiation through the neural network, and substantially reduces training complexity. At inference time, the computational cost of our method remains constant, regardless of the spatiotemporal resolution of the domain. Our experimental results demonstrate that our method significantly outperforms previous machine learning approaches in terms of speed and accuracy by one to two orders of magnitude on multiple different problems. When compared to numerical solvers of the same accuracy, our method demonstrates a $10\times$ increase in performance speed.


title: Derived Moduli Spaces of Nonlinear PDEs I: Singular Propagations

abstract: We construct a sheaf theoretic and derived geometric machinery to study nonlinear partial differential equations and their singular supports. We establish a notion of derived microlocalization for solution spaces of non-linear equations and develop a formalism to pose and solve singular non-linear Cauchy problems globally. Using this approach we estimate the domains of propagation for the solutions of non-linear systems. It is achieved by exploiting the fact that one may greatly enrich and simplify the study of derived non-linear PDEs over a space $X$ by studying its derived linearization which is a module over the sheaf of functions on the $S^1$-equivariant derived loop stack $\mathcal{L}X$.


title: Molecular Dynamics Simulation of Nanoporous Tungsten

abstract: Developing materials that can withstand the intense environments of nuclear fusion reactors is critical in developing long-term commercial viability for energy production. Tungsten is the primary candidate as a plasma facing material due to its exceptional resilience in extreme fusion settings. However, the continuous high energy helium and neutron damage threatens mechanical stability, calling into question the long time commercial reliability for fusion energy generation. In order to address these issues, novel methods of nanoporous structures have been shown to suppress and annihilate the accumulation of defects that leads to structural instability that can be applied to improve the reliability of tungsten as a plasma facing material. There is currently a lack of experimental data on nanoporous Tungsten that needs to be considered when choosing appropriate applications for this material. Molecular dynamic simulations were utilized in examining the mechanical and thermodynamic response of nanoporous tungsten systems under fusion reactor relevant conditions under compressive strain. Bicontinuous nanoporous structured Tungsten with small relative densities are shown to have outstanding thermodynamic and mechanical stability under compression compared to other Tungsten systems by possessing reduced defect densities and unique defect twinning.


title: The Fundamental Theorem of Calculus point-free, with applications to exponentials and logarithms

abstract: Working in point-free topology under the constraints of geometric logic, we prove the Fundamental Theorem of Calculus, and apply it to prove the usual rules for the derivatives of $x^\alpha$, $\gamma^x$, and $\log_\gamma x$.


title: Few-Shot Class-Incremental Learning via Training-Free Prototype Calibration

abstract: Real-world scenarios are usually accompanied by continuously appearing classes with scare labeled samples, which require the machine learning model to incrementally learn new classes and maintain the knowledge of base classes. In this Few-Shot Class-Incremental Learning (FSCIL) scenario, existing methods either introduce extra learnable components or rely on a frozen feature extractor to mitigate catastrophic forgetting and overfitting problems. However, we find a tendency for existing methods to misclassify the samples of new classes into base classes, which leads to the poor performance of new classes. In other words, the strong discriminability of base classes distracts the classification of new classes. To figure out this intriguing phenomenon, we observe that although the feature extractor is only trained on base classes, it can surprisingly represent the semantic similarity between the base and unseen new classes. Building upon these analyses, we propose a simple yet effective Training-frEE calibratioN (TEEN) strategy to enhance the discriminability of new classes by fusing the new prototypes (i.e., mean features of a class) with weighted base prototypes. In addition to standard benchmarks in FSCIL, TEEN demonstrates remarkable performance and consistent improvements over baseline methods in the few-shot learning scenario. Code is available at: https://github.com/wangkiw/TEEN


title: Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning

abstract: Despite their tremendous success in many applications, large language models often fall short of consistent reasoning and planning in various (language, embodied, and social) scenarios, due to inherent limitations in their inference, learning, and modeling capabilities. In this position paper, we present a new perspective of machine reasoning, LAW, that connects the concepts of Language models, Agent models, and World models, for more robust and versatile reasoning capabilities. In particular, we propose that world and agent models are a better abstraction of reasoning, that introduces the crucial elements of deliberate human-like reasoning, including beliefs about the world and other agents, anticipation of consequences, goals/rewards, and strategic planning. Crucially, language models in LAW serve as a backend to implement the system or its elements and hence provide the computational power and adaptability. We review the recent studies that have made relevant progress and discuss future research directions towards operationalizing the LAW framework.


title: Modeling Risk in Reinforcement Learning: A Literature Mapping

abstract: Safe reinforcement learning deals with mitigating or avoiding unsafe situations by reinforcement learning (RL) agents. Safe RL approaches are based on specific risk representations for particular problems or domains. In order to analyze agent behaviors, compare safe RL approaches, and effectively transfer techniques between application domains, it is necessary to understand the types of risk specific to safe RL problems. We performed a systematic literature mapping with the objective to characterize risk in safe RL. Based on the obtained results, we present definitions, characteristics, and types of risk that hold on multiple application domains. Our literature mapping covers literature from the last 5 years (2017-2022), from a variety of knowledge areas (AI, finance, engineering, medicine) where RL approaches emphasize risk representation and management. Our mapping covers 72 papers filtered systematically from over thousands of papers on the topic. Our proposed notion of risk covers a variety of representations, disciplinary differences, common training exercises, and types of techniques. We encourage researchers to include explicit and detailed accounts of risk in future safe RL research reports, using this mapping as a starting point. With this information, researchers and practitioners could draw stronger conclusions on the effectiveness of techniques on different problems.


title: High-Order Entropy Correction with SIAC Filters

abstract: This article considers the application of Smoothness-Increasing Accuracy-Conserving (SIAC) filtering for the non-linear stabilization of discontinuous Galerkin (DG) discretizations via entropy correction. Upon constructing discrete filters from continuous convolution SIAC kernels, the schemes are made to be conservative and are then appended to the DG method in a semi-discrete fashion. Performance of these tunable SIAC filters is compared to the local averaging typically employed in the entropy correction of finite element methods, and their capabilities are demonstrated for energy conservation as well as a shock regularization strategy based on an artificial viscosity estimate. Relaxation Runge-Kutta time integration methods are further employed in order to ensure a fully-discrete energy preserving procedure, with impacts of the overall solution accuracy being investigated for calculations of the one- and two-dimensional Burgers equation.


title: Tensorial properties via the neuroevolution potential framework: Fast simulation of infrared and Raman spectra

abstract: Infrared and Raman spectroscopy are widely used for the characterization of gases, liquids, and solids, as the spectra contain a wealth of information concerning in particular the dynamics of these systems. Atomic scale simulations can be used to predict such spectra but are often severely limited due to high computational cost or the need for strong approximations that limit application range and reliability. Here, we introduce a machine learning (ML) accelerated approach that addresses these shortcomings and provides a significant performance boost in terms of data and computational efficiency compared to earlier ML schemes. To this end, we generalize the neuroevolution potential approach to enable the prediction of rank one and two tensors to obtain the tensorial neuroevolution potential (TNEP) scheme. We apply the resulting framework to construct models for the dipole moment, polarizability, and susceptibility of molecules, liquids, and solids, and show that our approach compares favorably with several ML models from the literature with respect to accuracy and computational efficiency. Finally, we demonstrate the application of the TNEP approach to the prediction of infrared and Raman spectra of liquid water, a molecule (PTAF-), and a prototypical perovskite with strong anharmonicity (BaZrO3). The TNEP approach is implemented in the free and open source software package GPUMD, which makes this methodology readily available to the scientific community.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.chem-ph physics.comp-ph


title: The impact of heteroskedasticity on uplift modeling

abstract: There are various applications, where companies need to decide to which individuals they should best allocate treatment. To support such decisions, uplift models are applied to predict treatment effects on an individual level. Based on the predicted treatment effects, individuals can be ranked and treatment allocation can be prioritized according to this ranking. An implicit assumption, which has not been doubted in the previous uplift modeling literature, is that this treatment prioritization approach tends to bring individuals with high treatment effects to the top and individuals with low treatment effects to the bottom of the ranking. In our research, we show that heteroskedastictity in the training data can cause a bias of the uplift model ranking: individuals with the highest treatment effects can get accumulated in large numbers at the bottom of the ranking. We explain theoretically how heteroskedasticity can bias the ranking of uplift models and show this process in a simulation and on real-world data. We argue that this problem of ranking bias due to heteroskedasticity might occur in many real-world applications and requires modification of the treatment prioritization to achieve an efficient treatment allocation.


title: Generative AI in Higher Education: Seeing ChatGPT Through Universities' Policies, Resources, and Guidelines

abstract: The advancements in Generative Artificial Intelligence (GenAI) technologies such as ChatGPT provide opportunities to enrich educational experiences, but also raise concerns about academic integrity if misused. This study aims to explore how universities and educators respond and adapt to the development of GenAI in their academic contexts by analyzing academic policies and guidelines established by top-ranked US universities regarding the use of ChatGPT in higher education. The data sources include academic policies, statements, guidelines as well as relevant resources provided by the top 100 universities in the US. Results show that the majority of these universities adopt an open but cautious approach towards the integration of GenAI. Primary concerns lie in ethical usage, accuracy, and data privacy. Most universities actively respond and provide diverse types of resources, such as syllabus templates/samples, workshops, shared articles, and one-on-one consultations, with topics focusing on general technical introduction, ethical concerns, pedagogical applications, preventive strategies, data privacy, limitations, and detective tools. The findings provide two suggestions for educators in policy-making: establish discipline-specific policies, and manage sensitive information carefully, as well as four implications for educators in teaching practices: accept its presence, align its use with learning objectives, evolve curriculum to prevent misuse, and adopt multifaceted evaluation strategies rather than relying on AI detectors.


title: Euler Product Asymptotics for $L$-functions of Elliptic Curves

abstract: Let $E/\mathbb Q$ be an elliptic curve and for each prime $p$, let $N_p$ denote the number of points of $E$ modulo $p$. The original version of the Birch and Swinnerton-Dyer conjecture asserts that $\prod \limits _{p \leq x} \frac{N_p}{p} \sim C (\log x) ^{\text{rank}(E(\mathbb Q))}$ as $x \to \infty$. Goldfeld showed that this conjecture implies both the Riemann Hypothesis for $L(E, s)$ and the modern formulation of the conjecture i.e. that $\text{ord}_{s=1} L(E, s)= \text{rank}(E(\mathbb Q))$. In this paper, we prove that if we let $r=\text{ord} _{s=1}L(E, s)$, then under the assumption of the Riemann Hypothesis for $L(E, s)$, we have that $\prod \limits _{p \leq x} \frac{N_p}{p} \sim C (\log x)^r$ for all $x$ outside a set of finite logarithmic measure. As corollaries, we recover not only Goldfeld's result, but we also prove a result in the direction of the converse. Our method of proof is based on establishing the asymptotic behaviour of partial Euler products of $L(E, s)$ in the right-half of the critical strip.


title: HI Galaxy Signatures in the SARAO MeerKAT Galactic Plane Survey -- II. The Local Void and its substructure

abstract: The Local Void is one of the nearest large voids, located at a distance of 23 Mpc. It lies largely behind the Galactic Bulge and is therefore extremely difficult to observe. We use HI 21 cm emission observations from the SARAO MeerKAT Galactic Plane Survey (SMGPS) to study the Local Void and its surroundings over the Galactic longitude range 329$^{\circ}< \ell <$ 55$^{\circ}$, Galactic latitude $|b| <$ 1.5$^{\circ}$, and redshift $cz <$ 7500 km/s. We have detected 291 galaxies to median rms sensitivity of 0.44 mJy per beam per 44 km/s channel. We find 17 galaxies deep inside the Void, 96 at the border of the Void, while the remaining 178 galaxies are in average density environments. The extent of the Void is ~ 58 Mpc. It is severely under-dense for the longitude range 350$^{\circ}< \ell <$ 35$^{\circ}$ up to redshift $z <$ 4500 km/s. The galaxies in the Void tend to have \HI masses that are lower (by approximately 0.25 dex) than their average density counterparts. We find several potential candidates for small groups of galaxies, of which two groups (with 3 members and 5 members) in the Void show signs of filamentary substructure within the Void.


title: Quasi-rectifiable Lie algebras for partial differential equations

abstract: We introduce families of quasi-rectifiable vector fields and study their geometric and algebraic aspects. Then, we analyse their applications to systems of partial differential equations. Our results explain, in a simpler manner, previous findings about hydrodynamic-type equations. Facts concerning families of quasi-rectifiable vector fields, their relation to Hamiltonian systems, and practical procedures for studying such families are developed. We introduce and analyse quasi-rectifiable Lie algebras, which are motivated by geometric and practical reasons. We classify different types of quasi-rectifiable Lie algebras, e.g. indecomposable ones up to dimension five. New methods for solving systems of hydrodynamic-type equations are established to illustrate our results. In particular, we study hydrodynamic-type systems admitting $k$-wave solutions through quasi-rectifiable Lie algebras of vector fields. We develop techniques for obtaining the submanifolds related to quasi-rectifiable Lie algebras of vector fields and systems of partial differential equations admitting a nonlinear superposition rule: the PDE Lie systems.


title: SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation

abstract: Despite their ability to generate high-resolution and diverse images from text prompts, text-to-image diffusion models often suffer from slow iterative sampling processes. Model distillation is one of the most effective directions to accelerate these models. However, previous distillation methods fail to retain the generation quality while requiring a significant amount of images for training, either from real data or synthetically generated by the teacher model. In response to this limitation, we present a novel image-free distillation scheme named $\textbf{SwiftBrush}$. Drawing inspiration from text-to-3D synthesis, in which a 3D neural radiance field that aligns with the input prompt can be obtained from a 2D text-to-image diffusion prior via a specialized loss without the use of any 3D data ground-truth, our approach re-purposes that same loss for distilling a pretrained multi-step text-to-image model to a student network that can generate high-fidelity images with just a single inference step. In spite of its simplicity, our model stands as one of the first one-step text-to-image generators that can produce images of comparable quality to Stable Diffusion without reliance on any training image data. Remarkably, SwiftBrush achieves an FID score of $\textbf{16.67}$ and a CLIP score of $\textbf{0.29}$ on the COCO-30K benchmark, achieving competitive results or even substantially surpassing existing state-of-the-art distillation techniques.


title: Non-trivial units of complex group rings

abstract: The Kaplansky unit conjecture for group rings is false in characteristic zero.


title: Contra generative AI detection in higher education assessments

abstract: This paper presents a critical analysis of generative Artificial Intelligence (AI) detection tools in higher education assessments. The rapid advancement and widespread adoption of generative AI, particularly in education, necessitates a reevaluation of traditional academic integrity mechanisms. We explore the effectiveness, vulnerabilities, and ethical implications of AI detection tools in the context of preserving academic integrity. Our study synthesises insights from various case studies, newspaper articles, and student testimonies to scrutinise the practical and philosophical challenges associated with AI detection. We argue that the reliance on detection mechanisms is misaligned with the educational landscape, where AI plays an increasingly widespread role. This paper advocates for a strategic shift towards robust assessment methods and educational policies that embrace generative AI usage while ensuring academic integrity and authenticity in assessments.


title: The infinite Fibonacci cube and its generalizations

abstract: The Fibonacci cube $\Gamma_n$ is is the graph whose vertices are independent subsets of the path graph of length $n$, where two such vertices are considered adjacent if they differ by the addition or removal of a single element. Klav\v{z}ar [1] suggested considering the infinite Fibonacci cube $\Gamma_\infty$ whose vertices are independent subsets of the one-way infinite path graph with the same adjacency condition. We show that every connected component of $\Gamma_\infty$ is asymmetric (has no nontrivial automorphism) and no two connected components of $\Gamma_\infty$ are isomorphic. This follows from our results on a further generalization $\Gamma_G$ where $G$ is a simple, locally finite hypergraph with no isolated vertices.


title: Online Model-free Safety Verification for Markov Decision Processes Without Safety Violation

abstract: In this paper, we consider the problem of safety assessment for Markov decision processes without explicit knowledge of the model. We aim to learn probabilistic safety specifications associated with a given policy without compromising the safety of the process. To accomplish our goal, we characterize a subset of the state-space called proxy set, which contains the states that are near in a probabilistic sense to the forbidden set consisting of all unsafe states. We compute the safety function using the single-step temporal difference method. To this end, we relate the safety function computation to that of the value function estimation using temporal difference learning. Since the given control policy could be unsafe, we use a safe baseline subpolicy to generate data for learning. We then use an off-policy temporal difference learning method with importance sampling to learn the safety function corresponding to the given policy. Finally, we demonstrate our results using a numerical example


title: Laboratory realization of relativistic pair-plasma beams

abstract: Relativistic electron-positron plasmas are ubiquitous in extreme astrophysical environments such as black holes and neutron star magnetospheres, where accretion-powered jets and pulsar winds are expected to be enriched with such pair plasmas. Their behaviour is quite different from typical electron-ion plasmas due to the matter-antimatter symmetry of the charged components and their role in the dynamics of such compact objects is believed to be fundamental. So far, our experimental inability to produce large yields of positrons in quasi-neutral beams has restricted the understanding of electron-positron pair plasmas to simple numerical and analytical studies which are rather limited. We present first experimental results confirming the generation of high-density, quasi-neutral, relativistic electron-positron pair beams using the 440 GeV/c beam at CERN's Super Proton Synchrotron (SPS) accelerator. The produced pair beams have a volume that fills multiple Debye spheres and are thus able to sustain collective plasma oscillations. Our work opens up the possibility of directly probing the microphysics of pair plasmas beyond quasi-linear evolution into regimes that are challenging to simulate or measure via astronomical observations.


title: Dipolar coupled core-shell perpendicular shape anisotropy MTJ with enhanced write speed and reduced cross-talk

abstract: The concept of Perpendicular Shape-Anisotropy Spin-Transfer-Torque Magnetic Random-Access Memory tackles the downsize scalability limit of conventional ultrathin magnetic tunnel junctions (MTJ) below sub-20 nm technological nodes. This concept uses a thicker storage layer with a vertical aspect ratio, enhancing the thermal stability factor thanks to the favorable contribution of the shape anisotropy. However, the increased aspect ratio comes with an increase in switching time under applied voltage and the cross-over to non-uniform reversal mechanism at higher aspect ratio, limiting the gain in scalability. Additionally, the larger volume of the magnetic cell significantly increases the stray field acting on the neighboring devices compared to thin MTJs. In this work, we propose the use of a dipolar-coupled core-shell system as a storage layer. This improves both bottlenecks, as predicted by micromagnetic simulations for magnetisation reversal, and a macrospin model to estimate the stray field in a dense array.


title: SUPER and subpicosecond coherent control of an optical qubit in a tin-vacancy color center in diamond

abstract: The coherent excitation of an optically active spin system is one of the key elements in the engineering of a spin-photon interface. In this work, we use the novel SUPER scheme, employing nonresonant ultrashort optical pulses, to coherently control the main optical transition of a tin-vacancy color center in diamond, a promising emitter that can both be utilized as a quantum memory and a single-photon source. Furthermore, we implement a subpicosecond control scheme using resonant pulses for achieving record short quantum gates applied to diamond color centers. The employed ultrafast quantum gates open up a new regime of quantum information processing with solid-state color centers, eventually enabling multi-gate operations with the optical qubit and efficient spectral filtering of the excitation laser from deterministically prepared coherent photons.


title: Dynamic LiDAR Re-simulation using Compositional Neural Fields

abstract: We introduce DyNFL, a novel neural field-based approach for high-fidelity re-simulation of LiDAR scans in dynamic driving scenes. DyNFL processes LiDAR measurements from dynamic environments, accompanied by bounding boxes of moving objects, to construct an editable neural field. This field, comprising separately reconstructed static background and dynamic objects, allows users to modify viewpoints, adjust object positions, and seamlessly add or remove objects in the re-simulated scene. A key innovation of our method is the neural field composition technique, which effectively integrates reconstructed neural assets from various scenes through a ray drop test, accounting for occlusions and transparent surfaces. Our evaluation with both synthetic and real-world environments demonstrates that DyNFL substantially improves dynamic scene LiDAR simulation, offering a combination of physical fidelity and flexible editing capabilities.


title: Topology-Based Reconstruction Prevention for Decentralised Learning

abstract: Decentralised learning has recently gained traction as an alternative to federated learning in which both data and coordination are distributed over its users. To preserve data confidentiality, decentralised learning relies on differential privacy, multi-party computation, or a combination thereof. However, running multiple privacy-preserving summations in sequence may allow adversaries to perform reconstruction attacks. Unfortunately, current reconstruction countermeasures either cannot trivially be adapted to the distributed setting, or add excessive amounts of noise. In this work, we first show that passive honest-but-curious adversaries can infer other users' private data after several privacy-preserving summations. For example, in subgraphs with 18 users, we show that only three passive honest-but-curious adversaries succeed at reconstructing private data 11.0% of the time, requiring an average of 8.8 summations per adversary. The success rate depends only on the adversaries' direct neighbourhood, independent of the size of the full network. We consider weak adversaries, who do not control the graph topology and can exploit neither the inner workings of the summation protocol nor the specifics of users' data. We develop a mathematical understanding of how reconstruction relates to topology and propose the first topology-based decentralised defence against reconstruction attacks. Specifically, we show that reconstruction requires a number of adversaries linear in the length of the network's shortest cycle. Consequently, reconstructing private data from privacy-preserving summations is impossible in acyclic networks. Our work is a stepping stone for a formal theory of topology-based reconstruction defences. Such a theory would generalise our countermeasure beyond summation, define confidentiality in terms of entropy, and describe the effects of differential privacy.


title: Sub-ppm Nanomechanical Absorption Spectroscopy of Silicon Nitride

abstract: Material absorption is a key limitation in nanophotonic systems; however, its characterization is often obscured by scattering and diffraction loss. Here we show that nanomechanical frequency spectroscopy can be used to characterize the absorption of a dielectric thin film at the parts-per-million (ppm) level, and use it to characterize the absorption of stoichiometric silicon nitride (Si$_3$N$_4$), a ubiquitous low-loss optomechanical material. Specifically, we track the frequency shift of a high-$Q$ Si$_3$N$_4$ trampoline resonator in response to photothermal heating by a $\sim10$ mW laser beam, and infer the absorption of the thin film from a model including thermal stress relaxation and both radiative and conductive heat transfer. A key insight is the presence of two thermalization timescales, a rapid ($\sim0.1$ sec) timescale due to radiative thermalization of the Si$_3$N$_4$ thin film, and a slow ($\sim100$ sec) timescale due to parasitic heating of the Si device chip. We infer the extinction coefficient of Si$_3$N$_4$ to be $\sim0.1-1$ ppm in the 532 - 1550 nm wavelength range, comparable to bounds set by waveguide resonators and notably lower than estimates with membrane-in-the-middle cavity optomechanical systems. Our approach is applicable to a broad variety of nanophotonic materials and may offer new insights into their potential.

categories: physics.optics cond-mat.mes-hall physics.app-ph physics.ins-det


title: TaskMet: Task-Driven Metric Learning for Model Learning

abstract: Deep learning models are often deployed in downstream tasks that the training procedure may not be aware of. For example, models solely trained to achieve accurate predictions may struggle to perform well on downstream tasks because seemingly small prediction errors may incur drastic task errors. The standard end-to-end learning approach is to make the task loss differentiable or to introduce a differentiable surrogate that the model can be trained on. In these settings, the task loss needs to be carefully balanced with the prediction loss because they may have conflicting objectives. We propose take the task loss signal one level deeper than the parameters of the model and use it to learn the parameters of the loss function the model is trained on, which can be done by learning a metric in the prediction space. This approach does not alter the optimal prediction model itself, but rather changes the model learning to emphasize the information important for the downstream task. This enables us to achieve the best of both worlds: a prediction model trained in the original prediction space while also being valuable for the desired downstream task. We validate our approach through experiments conducted in two main settings: 1) decision-focused model learning scenarios involving portfolio optimization and budget allocation, and 2) reinforcement learning in noisy environments with distracting states. The source code to reproduce our experiments is available at https://github.com/facebookresearch/taskmet


title: Reconstructing Hands in 3D with Transformers

abstract: We present an approach that can reconstruct hands in 3D from monocular input. Our approach for Hand Mesh Recovery, HaMeR, follows a fully transformer-based architecture and can analyze hands with significantly increased accuracy and robustness compared to previous work. The key to HaMeR's success lies in scaling up both the data used for training and the capacity of the deep network for hand reconstruction. For training data, we combine multiple datasets that contain 2D or 3D hand annotations. For the deep model, we use a large scale Vision Transformer architecture. Our final model consistently outperforms the previous baselines on popular 3D hand pose benchmarks. To further evaluate the effect of our design in non-controlled settings, we annotate existing in-the-wild datasets with 2D hand keypoint annotations. On this newly collected dataset of annotations, HInt, we demonstrate significant improvements over existing baselines. We make our code, data and models available on the project website: https://geopavlakos.github.io/hamer/.


title: Force-Free Fields are Conformally Geodesic

abstract: In this paper, we establish an equivalence between force-free fields and conformally geodesic fields, and between harmonic fields and conformally eikonal fields in the context of conformal geometry. In contrast to previous work, our approach and equivalence results generalize to arbitrary dimensions. In accordance with three-dimensional theory, our defining equations emerge as the Euler-Lagrange equations of hierarchies of variational principles - distinguished by the topological constraints they impose - and retain the known inclusions of the special cases from each other. Specifically, we relate stationary points of hierarchies of $L^2$ resp. $L^1$-optimization problems by a conformal change of metric, provide an explicit construction of the conformal factors relating the relevant metrics and identify the field lines of physical vector fields fields as conformal geodesics. Despite the allowed topological complexity of the fields under consideration, these observations reveal geometric order which is obtained by merely pointwise rescaling of the metric.


title: DiSK: A Diffusion Model for Structured Knowledge

abstract: Structured (dictionary-like) data presents challenges for left-to-right language models, as they can struggle with structured entities for a wide variety of reasons such as formatting and sensitivity to the order in which attributes are presented. Tabular generative models suffer from a different set of limitations such as their lack of flexibility. We introduce Diffusion Models of Structured Knowledge (DiSK) - a new architecture and training approach specialized for structured data. DiSK handles text, categorical, and continuous numerical data using a Gaussian mixture model approach, which allows for improved precision when dealing with numbers. It employs diffusion training to model relationships between properties. Experiments demonstrate DiSK's state-of-the-art performance on tabular data modeling, synthesis, and imputation on over 15 datasets across diverse domains. DiSK provides an effective inductive bias for generative modeling and manipulation of structured data. The techniques we propose could open the door to improved knowledge manipulation in future language models.