title: Overview of the CAIL 2023 Argument Mining Track

abstract: We give a detailed overview of the CAIL 2023 Argument Mining Track, one of the Chinese AI and Law Challenge (CAIL) 2023 tracks. The main goal of the track is to identify and extract interacting argument pairs in trial dialogs. It mainly uses summarized judgment documents but can also refer to trial recordings. The track consists of two stages, and we introduce the tasks designed for each stage; we also extend the data from previous events into a new dataset -- CAIL2023-ArgMine -- with annotated new cases from various causes of action. We outline several submissions that achieve the best results, including their methods for different stages. While all submissions rely on language models, they have incorporated strategies that may benefit future work in this field.


title: Translating Across Cultures: LLMs for Intralingual Cultural Adaptation

abstract: LLMs are increasingly being deployed for multilingual applications and have demonstrated impressive translation capabilities between several low and high resource languages. An aspect of translation that often gets overlooked is that of cultural adaptation, or modifying source culture references to suit the target culture. Cultural adaptation has applications across several creative industries and requires intimate knowledge of source and target cultures during translation. While specialized translation models still outperform LLMs on the machine translation task when viewed from the lens of correctness, they are not sensitive to cultural differences often requiring manual correction. LLMs on the other hand have a rich reservoir of cultural knowledge embedded within its parameters that can be potentially exploited for such applications. In this paper we define the task of cultural adaptation and create an evaluation framework to benchmark different models for this task. We evaluate the performance of modern LLMs for cultural adaptation and analyze their cross cultural knowledge while connecting related concepts across different cultures. We also analyze possible issues with automatic adaptation including cultural biases and stereotypes. We hope that this task will offer more insight into the cultural understanding of LLMs and their creativity in cross-cultural scenarios.


title: Dynamics of colloidal rods rotating in viscoelastic media

abstract: We experimentally investigate the in-plane rotational motion of ferromagnetic colloidal rods in viscoelastic media under a rotating magnetic field. Contrary to their rotation in a Newtonian fluid, in a viscoelastic fluid the rods continue to exhibit a net angular drift even for applied field frequencies which is an order of magnitude larger than the step-out frequency. Despite experimental evidence, previous studies failed to explain the observed behavior. This is due to the inherent assumption that the rods angular velocity beyond step-out follows same dependence on the applied field frequency as the Newtonian fluids. We demonstrated that the observed net rotation of rods after step-out originates from their interaction with the microstructural stress-relaxation processes within the viscoelastic fluid. Consequently, it exhibits a strong dependence on the rheological properties of the fluid. Our results are further supported by a minimal model which incorporates the memory-mediated response of the viscoelastic fluid on their motion. Furthermore, we demonstrate, both experimentally and numerically, that the observed effect represents a generic feature of viscoelastic media and is expected to manifest for elongated probes in other complex surroundings such as biological assays and colloidal glasses.


title: Online Matching and Contention Resolution for Edge Arrivals with Vanishing Probabilities

abstract: We study the performance of sequential contention resolution and matching algorithms on random graphs with vanishing edge probabilities. When the edges of the graph are processed in an adversarially-chosen order, we derive a new OCRS that is $0.382$-selectable, attaining the "independence benchmark" from the literature under the vanishing edge probabilities assumption. Complementary to this positive result, we show that no OCRS can be more than $0.390$-selectable, significantly improving upon the upper bound of $0.428$ from the literature. We also derive negative results that are specialized to bipartite graphs or subfamilies of OCRS's. Meanwhile, when the edges of the graph are processed in a uniformly random order, we show that the simple greedy contention resolution scheme which accepts all active and feasible edges is $1/2$-selectable. This result is tight due to a known upper bound. Finally, when the algorithm can choose the processing order, we show that a slight tweak to the random order -- give each vertex a random priority and process edges in lexicographic order -- results in a strictly better contention resolution scheme that is $1-\ln(2-1/e)\approx0.510$-selectable. Our positive results also apply to online matching on $1$-uniform random graphs with vanishing (non-identical) edge probabilities, extending and unifying some results from the random graphs literature.


title: On Newton's Method to Unlearn Neural Networks

abstract: Machine unlearning facilitates personal data ownership, including the ``right to be forgotten''. The proliferation of applications of \emph{neural networks} (NNs) trained on users' personal data calls for the need to develop algorithms to unlearn an NN. Since retraining is costly, efficiency is often achieved through approximate unlearning which aims to unlearn a trained NN to be close to the retrained one (in distribution). Though the Newton's method has been used by previous works to approximately unlearn linear models, adapting it for unlearning an NN often encounters degenerate Hessians that make computing the Newton's update impossible. In this paper, we will first show that when coupled with naive yet often effective solutions to mitigate the degeneracy issue for unlearning, the Newton's method surprisingly suffers from catastrophic forgetting. To overcome this difficulty, we revise the Newton's method to include a theoretically justified regularizer and propose a cubic-regularized Newton's method for unlearning an NN. The cubic regularizer comes with the benefits of not requiring manual finetuning and affording a natural interpretation. Empirical evaluation on several models and real-world datasets shows that our method is more resilient to catastrophic forgetting and performs better than the baselines, especially in sequential unlearning.


title: Evidence of a log scaling law for political persuasion with large language models

abstract: Large language models can now generate political messages as persuasive as those written by humans, raising concerns about how far this persuasiveness may continue to increase with model size. Here, we generate 720 persuasive messages on 10 U.S. political issues from 24 language models spanning several orders of magnitude in size. We then deploy these messages in a large-scale randomized survey experiment (N = 25,982) to estimate the persuasive capability of each model. Our findings are twofold. First, we find evidence of a log scaling law: model persuasiveness is characterized by sharply diminishing returns, such that current frontier models are barely more persuasive than models smaller in size by an order of magnitude or more. Second, mere task completion (coherence, staying on topic) appears to account for larger models' persuasive advantage. These findings suggest that further scaling model size will not much increase the persuasiveness of static LLM-generated messages.


title: Consistency and independence phenomena involving cellular-Lindelof spaces

abstract: The cellular-Lindel\"of property is a common generalization of the Lindel\"of property and the countable chain condition that was introduced by Bella and Spadaro in 2018. We solve two questions of Alas, Gutierrez-Dominguez and Wilson by constructing consistent examples of a normal almost cellular-Lindel\"of space which is neither cellular-Lindel\"of nor weakly Lindel\"of and a Tychonoff cellular-Lindel\"of space of Lindel\"of degree $\omega_1$ and uncountable weak Lindel\"of degree for closed sets. We also construct a ZFC example of a space for which both the cellular-Lindel\"of property and normality are undetermined in ZFC.


title: V-LASIK: Consistent Glasses-Removal from Videos Using Synthetic Data

abstract: Diffusion-based generative models have recently shown remarkable image and video editing capabilities. However, local video editing, particularly removal of small attributes like glasses, remains a challenge. Existing methods either alter the videos excessively, generate unrealistic artifacts, or fail to perform the requested edit consistently throughout the video. In this work, we focus on consistent and identity-preserving removal of glasses in videos, using it as a case study for consistent local attribute removal in videos. Due to the lack of paired data, we adopt a weakly supervised approach and generate synthetic imperfect data, using an adjusted pretrained diffusion model. We show that despite data imperfection, by learning from our generated data and leveraging the prior of pretrained diffusion models, our model is able to perform the desired edit consistently while preserving the original video content. Furthermore, we exemplify the generalization ability of our method to other local video editing tasks by applying it successfully to facial sticker-removal. Our approach demonstrates significant improvement over existing methods, showcasing the potential of leveraging synthetic data and strong video priors for local video editing tasks.


title: Investigating Mysteries of CoT-Augmented Distillation

abstract: Eliciting "chain of thought" (CoT) rationales -- sequences of token that convey a "reasoning" process -- has been shown to consistently improve LLM performance on tasks like question answering. More recent efforts have shown that such rationales can also be used for model distillation: Including CoT sequences (elicited from a large "teacher" model) in addition to target labels when fine-tuning a small student model yields (often substantial) improvements. In this work we ask: Why and how does this additional training signal help in model distillation? We perform ablations to interrogate this, and report some potentially surprising results. Specifically: (1) Placing CoT sequences after labels (rather than before) realizes consistently better downstream performance -- this means that no student "reasoning" is necessary at test time to realize gains. (2) When rationales are appended in this way, they need not be coherent reasoning sequences to yield improvements; performance increases are robust to permutations of CoT tokens, for example. In fact, (3) a small number of key tokens are sufficient to achieve improvements equivalent to those observed when full rationales are used in model distillation.


title: Scaling up global kinetic models of pulsar magnetospheres using a hybrid force-free-PIC numerical approach

abstract: The particle-in-cell approach has proven effective at modeling neutron star and black hole magnetospheres from first principles, but global simulations are plagued with an unrealistically small separation between the scales where microphysics operates and the system-size scales due to limited numerical resources. A legitimate concern is whether the scale separation currently achieved is large enough, such that results can be safely extrapolated to realistic scales. In this work, our aim is to explore the effect of scaling physical parameters up, and to check whether salient features uncovered by pure kinetic models at smaller scales are still valid, with a special emphasis on particle acceleration and high-energy radiation emitted beyond the light cylinder. To reach this objective, we develop a new hybrid numerical scheme coupling the ideal force-free and the particle-in-cell methods, to optimize the numerical cost of global models. We propose a domain decomposition of the magnetosphere based on the magnetic field topology using the flux function. The force-free model is enforced along open field lines while the particle-in-cell model is restricted to the reconnecting field line region. As a proof of concept, this new hybrid model is applied to simulate a weak millisecond pulsar magnetosphere with realistic scales using high-resolution axisymmetric simulations. Magnetospheric features reported by previous kinetic models are recovered, and strong synchrotron radiation above 100MeV consistent with the Fermi-LAT gamma-ray pulsar population is successfully reproduced. This work further consolidates the shining reconnecting current sheet scenario as the origin of the gamma-ray emission in pulsars, as well as firmly establishes pulsar magnetospheres as at least TeV particle accelerators.


title: On fibered Burnside rings, fiber change maps and cyclic fiber groups

abstract: Fibered Burnside rings appear as Grothendieck rings of fibered permutation representations of a finite group, generalizing Burnside rings and monomial representation rings. Their species, primitive idempotents and their conductors are of particular interest in representation theory as they encode information related to the structure of the group. In this note, we introduce fiber change maps between fibered Burnside rings, and we present results on their functoriality and naturality with respect to biset operations. We present some advances on the conductors for cyclic fiber groups, and fully determine them in particular cases, covering a wide range of interesting examples.


title: Solving a Stackelberg Game on Transportation Networks in a Dynamic Crime Scenario: A Mixed Approach on Multi-Layer Networks

abstract: Interdicting a criminal with limited police resources is a challenging task as the criminal changes location over time. The size of the large transportation network further adds to the difficulty of this scenario. To tackle this issue, we consider the concept of a layered graph. At each time stamp, we create a copy of the entire transportation network to track the possible movements of both players, the attacker and the defenders. We consider a Stackelberg game in a dynamic crime scenario where the attacker changes location over time while the defenders attempt to interdict the attacker on his escape route. Given a set of defender strategies, the optimal attacker strategy is determined by applying Dijkstra's algorithm on the layered networks. Here, the attacker aims to minimize while the defenders aim to maximize the probability of interdiction. We develop an approximation algorithm on the layered networks to find near-optimal strategy for defenders. The efficacy of the developed approach is compared with the adopted MILP approach. We compare the results in terms of computational time and solution quality. The quality of the results demonstrates the need for the developed approach, as it effectively solves the complex problem within a short amount of time.


title: MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding

abstract: The advent of large vision-language models (LVLMs) has spurred research into their applications in multi-modal contexts, particularly in video understanding. Traditional VideoQA benchmarks, despite providing quantitative metrics, often fail to encompass the full spectrum of video content and inadequately assess models' temporal comprehension. To address these limitations, we introduce MMBench-Video, a quantitative benchmark designed to rigorously evaluate LVLMs' proficiency in video understanding. MMBench-Video incorporates lengthy videos from YouTube and employs free-form questions, mirroring practical use cases. The benchmark is meticulously crafted to probe the models' temporal reasoning skills, with all questions human-annotated according to a carefully constructed ability taxonomy. We employ GPT-4 for automated assessment, demonstrating superior accuracy and robustness over earlier LLM-based evaluations. Utilizing MMBench-Video, we have conducted comprehensive evaluations that include both proprietary and open-source LVLMs for images and videos. MMBench-Video stands as a valuable resource for the research community, facilitating improved evaluation of LVLMs and catalyzing progress in the field of video understanding. The evalutation code of MMBench-Video will be integrated into VLMEvalKit: https://github.com/open-compass/VLMEvalKit.


title: Extended error threshold mechanism in {\it quasispecies} theory via population dynamics

abstract: We investigate Eigen's model for the evolution of the genetic code of microorganisms using a novel method based on population dynamics analysis. This model, for a given number of offspring, determines long-term survival as a function of the "genetic" information length and copy error probability. There exists a maximum threshold for the quantity of information that can be consistently preserved through the process of evolution within a population of perfectly replicating sequences, meaning no errors are allowed. With our formula, we expand upon the traditional error threshold formula of Eigen's theory and introduce a new expression for general cases where the self-reproduction process allows up to any integer number of copying errors per digit per replication step.


title: PostMark: A Robust Blackbox Watermark for Large Language Models

abstract: The most effective techniques to detect LLM-generated text rely on inserting a detectable signature -- or watermark -- during the model's decoding process. Most existing watermarking methods require access to the underlying LLM's logits, which LLM API providers are loath to share due to fears of model distillation. As such, these watermarks must be implemented independently by each LLM provider. In this paper, we develop PostMark, a modular post-hoc watermarking procedure in which an input-dependent set of words (determined via a semantic embedding) is inserted into the text after the decoding process has completed. Critically, PostMark does not require logit access, which means it can be implemented by a third party. We also show that PostMark is more robust to paraphrasing attacks than existing watermarking methods: our experiments cover eight baseline algorithms, five base LLMs, and three datasets. Finally, we evaluate the impact of PostMark on text quality using both automated and human assessments, highlighting the trade-off between quality and robustness to paraphrasing. We release our code, outputs, and annotations at https://github.com/lilakk/PostMark.


title: Algebraic geometry of bubbling Kahler metrics

abstract: We give an algebro-geometric or non-archimedean framework to study bubbling phenomena of Kahler metrics with Euclidean volume growth, after [DS17, Sun23, dBS23]. In particular, for any degenerating family to log terminal singularity, we algebraically construct a finite sequence of birational modifications of the family with milder degenerations, and compare with analytic bubbling constructions in loc.cit. We also provide approaches in terms of coordinates and valuations. Our discussion partially depends on the general framework of stability theory in our [Od24b] (arXiv:2406.02489) after [HL14, AHLH23].


title: ForSE+: Simulating non-Gaussian CMB foregrounds at 3 arcminutes in a stochastic way based on a generative adversarial network

abstract: We present ForSE+, a Python package that produces non-Gaussian diffuse Galactic thermal dust emission maps at arcminute angular scales and that has the capacity to generate random realizations of small scales. This represents an extension of the ForSE (Foreground Scale Extender) package, which was recently proposed to simulate non-Gaussian small scales of thermal dust emission using generative adversarial networks (GANs). With the input of the large-scale polarization maps from observations, ForSE+ has been trained to produce realistic polarized small scales at 3' following the statistical properties, mainly the non-Gaussianity, of observed intensity small scales, which are evaluated through Minkowski functionals. Furthermore, by adding different realizations of random components to the large-scale foregrounds, we show that ForSE+ is able to generate small scales in a stochastic way. In both cases, the output small scales have a similar level of non-Gaussianity compared with real observations and correct amplitude scaling as a power law. These realistic new maps will be useful, in the future, to understand the impact of non-Gaussian foregrounds on the measurements of the cosmic microwave background (CMB) signal, particularly on the lensing reconstruction, de-lensing, and the detection of cosmological gravitational waves in CMB polarization B-modes.


title: Energy Mapping of Existing Building Stock in Cambridge using Energy Performance Certificates and Thermal Infrared Imagery

abstract: Energy performance certificate (EPC) and thermal infrared (TIR) images both play a key role in the energy performance mapping of the urban building stock. In this paper, we developed parametric building archetypes using an EPC database and conducted temperature clustering on TIR images acquired through drones and satellite datasets. We evaluated 1725 EPCs of existing building stock in Cambridge, UK to generate energy consumption profiles. Drone-based TIR images of individual buildings in two Cambridge University colleges were processed using a machine learning pipeline for thermal anomaly detection and investigated the influence of two specific factors that affect the reliability of TIR for energy management applications: ground sample distance (GSD) and angle of view (AOV). The EPC-level results suggest that the construction year of the buildings influences their energy consumption. For example, modern buildings were over 30% more energy-efficient than older ones. Parallelly, older buildings were found to show almost double the energy savings potential through retrofitting than newly constructed buildings. TIR imaging results showed that thermal anomalies can only be properly identified in images with a GSD of 1m/pixel or less. A GSD of 1-6m/pixel can detect hot areas of building surfaces. We found that a GSD > 6m/pixel cannot characterise individual buildings but does help identify urban heat island effects. Additional sensitivity analysis showed that building thermal anomaly detection is more sensitive to AOV than to GSD. Our study informs newer approaches to building energy diagnostics using thermography and supports decision-making for retrofitting at a large scale.


title: Photoacoustic methane detection assisted by a gas-filled anti-resonant hollow-core fiber laser

abstract: Photoacoustic spectroscopys (PAS)-based methane (CH4) detectors have garnered significant attention with various developed systems using near-infrared (NIR) laser sources, which requires high-energy and narrow-linewidth laser sources to achieve high-sensitivity and low-concentration gas detection. The anti-resonant hollow-core fiber (ARHCF) lasers in the NIR and mid-infrared (MIR) spectral domain show a great potential for spectroscopy and high-resolution gas detection. In this work, we demonstrate the generation of a frequency-comb-like Raman laser with high pulse energy spanning from ultraviolet (UV) (328 nm) to NIR (2065 nm wavelength) based on a hydrogen (H2)-filled 7-ring ARHCF. The gas-filled ARHCF fiber is pumped with a custom-laser at 1044 nm with ~100 {\mu}J pulse energy and a few nanoseconds duration. Through stimulated Raman scattering process, we employ the sixth-order Stokes as case example located at ~1650 nm to demonstrate how the developed high-energy and narrow-linewidth laser source can effectively be used to detect CH4 in the NIR-II region using the photoacoustic modality. We report the efficient detection of CH4 with sensitivity as low as ~550 ppb with an integration time of ~40 s. In conclusion, the main goal of this work is to demonstrate and emphasize the potential of the gas-filled ARHCF laser technology for compact next-generation spectroscopy across different spectral regions.


title: Learning thresholds lead to stable language coexistence

abstract: We introduce a language competition model that incorporates the effects of memory and learning on the language shift dynamics, using the Abrams-Strogatz model as a starting point. On a coarse grained time scale, the effects of memory and learning can be expressed as thresholds on the speakers fractions. In its simplest form, the resulting model is exactly solvable. Besides the consensus on one of the two languages, the model describes additional equilibrium states that are not present in the Abrams-Strogatz model: a stable coexistence of the two languages, if both thresholds are low enough, so that the language shift processes in the two opposite directions compensate each other, and a frozen state coinciding with the initial state, when both thresholds are too high for any language shift to take place. We show numerically that these results are preserved for threshold functions of a more general shape.


title: Optical and Raman selection rules for odd-parity clean superconductors

abstract: We derive selection rules in optical absorption and Raman scattering spectra, that can determine the parity of pairing order parameters under inversion symmetry in two classes of \emph{clean} superconductors: (i) chiral superconductors with strong spin-orbit couplings, (ii) singlet superconductors with negligible spin-orbit couplings. Experimentally, the inversion parity of pair wave functions can be determined by comparing the "optical gap" $\Delta_\text{op}$ in Raman and optical spectroscopy and the "thermodynamic gap" $2\Delta$ in specific heat measurements, and the selection rules apply when $\Delta_\text{op}>2\Delta$. We demonstrate the selection rules in superconductivity in models of (i) doped Weyl semimetals and (ii) doped graphene. Our derivation is based on the relation between pairing symmetry and fermion projective symmetry group of a superconductor. We further derive similar selection rules for two-dimensional superconductors with 2-fold rotational symmetry, and discuss how they apply to the superconducting state in magic-angle twisted bilayer graphene.


title: High-Tc superconductor candidates proposed by machine learning

abstract: We cast the relation between chemical compositions of solid-state materials and their superconducting critical temperature (Tc) in terms of a statistical learning problem with reduced complexity. Training of query-aware similarity-based ridge regression models on experimental SuperCon data with (implicit) and without (ambient) high pressure entries achieves average Tc prediction errors of ~10 K for unseen out-of-sample materials. Subsequent utilization of the approach to scan ~153k materials in the Materials Project enables the ranking of candidates by Tc while taking into account thermodynamic stability and small band gap. Stable top three high-Tc candidate materials with large band gaps for implicit and ambient pressures are predicted to be Cs2Sn(H2N)6 (324 K), CsH5N2 (315K), Rb2Sn(H2N)6 (305 K), and H15IrBr3N5 (189 K), H12OsN5Cl3O (161 K), B10H13I (151 K), respectively. Stable top three high-Tc candidate materials with small band gaps for implicit and ambient pressures are predicted to be RbLiH12Se3N4 (255 K), CeH14Cl3O7 (246 K), Li(H3N)4 (234 K), and ReH30Ru2(NCl)10 (127 K), AlH18Ru(NF)6 (120 K), Sr(Li2P)2 (117 K), respectively.


title: Towards evolution of Deep Neural Networks through contrastive Self-Supervised learning

abstract: Deep Neural Networks (DNNs) have been successfully applied to a wide range of problems. However, two main limitations are commonly pointed out. The first one is that they require long time to design. The other is that they heavily rely on labelled data, which can sometimes be costly and hard to obtain. In order to address the first problem, neuroevolution has been proved to be a plausible option to automate the design of DNNs. As for the second problem, self-supervised learning has been used to leverage unlabelled data to learn representations. Our goal is to study how neuroevolution can help self-supervised learning to bridge the gap to supervised learning in terms of performance. In this work, we propose a framework that is able to evolve deep neural networks using self-supervised learning. Our results on the CIFAR-10 dataset show that it is possible to evolve adequate neural networks while reducing the reliance on labelled data. Moreover, an analysis to the structure of the evolved networks suggests that the amount of labelled data fed to them has less effect on the structure of networks that learned via self-supervised learning, when compared to individuals that relied on supervised learning.


title: Fantastic Copyrighted Beasts and How (Not) to Generate Them

abstract: Recent studies show that image and video generation models can be prompted to reproduce copyrighted content from their training data, raising serious legal concerns around copyright infringement. Copyrighted characters, in particular, pose a difficult challenge for image generation services, with at least one lawsuit already awarding damages based on the generation of these characters. Yet, little research has empirically examined this issue. We conduct a systematic evaluation to fill this gap. First, we build CopyCat, an evaluation suite consisting of diverse copyrighted characters and a novel evaluation pipeline. Our evaluation considers both the detection of similarity to copyrighted characters and generated image's consistency with user input. Our evaluation systematically shows that both image and video generation models can still generate characters even if characters' names are not explicitly mentioned in the prompt, sometimes with only two generic keywords (e.g., prompting with "videogame, plumber" consistently generates Nintendo's Mario character). We then introduce techniques to semi-automatically identify such keywords or descriptions that trigger character generation. Using our evaluation suite, we study runtime mitigation strategies, including both existing methods and new strategies we propose. Our findings reveal that commonly employed strategies, such as prompt rewriting in the DALL-E system, are not sufficient as standalone guardrails. These strategies must be coupled with other approaches, like negative prompting, to effectively reduce the unintended generation of copyrighted characters. Our work provides empirical grounding to the discussion of copyright mitigation strategies and offers actionable insights for model deployers actively implementing them.


title: Ambiguity Clustering: an accurate and efficient decoder for qLDPC codes

abstract: Error correction allows a quantum computer to preserve a state long beyond the decoherence time of its physical qubits by encoding logical qubits in a larger number of physical qubits. The leading proposal for a scheme of quantum error correction is based on the surface code, but several recently proposed quantum low-density parity check (qLDPC) codes allow more logical information to be encoded in significantly fewer physical qubits. Key to any scheme of quantum error correction is the decoder, an algorithm that estimates the error state of the qubits from the results of syndrome measurements performed on them. The surface code has a variety of fast and accurate decoders, but the state-of-the-art decoder for general qLDPC codes, BP-OSD, has a high computational complexity. Here we introduce Ambiguity Clustering (AC), an algorithm which seeks to divide the measurement data into clusters which are decoded independently. We benchmark AC on the recently proposed bivariate bicycle codes and find that, at physically realistic error rates, AC is between one and three orders of magnitude faster than BP-OSD with no reduction in logical fidelity. Our CPU implementation of AC is already fast enough to decode the 144-qubit Gross code in real time for neutral atom and trapped ion systems.


title: DeciMamba: Exploring the Length Extrapolation Potential of Mamba

abstract: Long-range sequence processing poses a significant challenge for Transformers due to their quadratic complexity in input length. A promising alternative is Mamba, which demonstrates high performance and achieves Transformer-level capabilities while requiring substantially fewer computational resources. In this paper we explore the length-generalization capabilities of Mamba, which we find to be relatively limited. Through a series of visualizations and analyses we identify that the limitations arise from a restricted effective receptive field, dictated by the sequence length used during training. To address this constraint, we introduce DeciMamba, a context-extension method specifically designed for Mamba. This mechanism, built on top of a hidden filtering mechanism embedded within the S6 layer, enables the trained model to extrapolate well even without additional training. Empirical experiments over real-world long-range NLP tasks show that DeciMamba can extrapolate to context lengths that are 25x times longer than the ones seen during training, and does so without utilizing additional computational resources. We will release our code and models.


title: A Benchmarking Study of Kolmogorov-Arnold Networks on Tabular Data

abstract: Kolmogorov-Arnold Networks (KANs) have very recently been introduced into the world of machine learning, quickly capturing the attention of the entire community. However, KANs have mostly been tested for approximating complex functions or processing synthetic data, while a test on real-world tabular datasets is currently lacking. In this paper, we present a benchmarking study comparing KANs and Multi-Layer Perceptrons (MLPs) on tabular datasets. The study evaluates task performance and training times. From the results obtained on the various datasets, KANs demonstrate superior or comparable accuracy and F1 scores, excelling particularly in datasets with numerous instances, suggesting robust handling of complex data. We also highlight that this performance improvement of KANs comes with a higher computational cost when compared to MLPs of comparable sizes.


title: Relative Group Trisections

abstract: Trisections of closed 4-manifolds, first defined and studied by Gay and Kirby, have proved to be a useful tool in the systematic analysis of 4-manifolds via handlebodies. Subsequent work of Abrams, Gay, and Kirby established a connection with the algebraic notion of a group trisection, which strikingly defines a one-to-one correspondence. We generalize the notion of a group trisection to the non-closed case by defining and studying relative group trisections. We establish an analogous one-to-one correspondence between relative trisections and relative group trisections up to equivalence. The key lemma in the construction may be of independent interest, as it generalizes the classical fact that there is a unique handlebody extension of a surface realizing a given surjection. Moreover, we establish a functorial relationship between relative trisections of manifolds and groups, extending work of Klug in the closed case.


title: Roman FFP Revolution: Two, Three, Many Plutos

abstract: Roman microlensing stands at a crossroads between its originally charted path of cataloging a population of cool planets that has subsequently become well-measured down to super-Earths, and the path of free-floating planets (FFPs), which did not exist when Roman was chosen in 2010, but by now promises revolutionary insights into planet formation and evolution via their possible connection to a spectrum of objects spanning 18 decades in mass. Until now, it was not even realized that the 2 paths are in conflict: Roman strategy was optimized for bound-planet detections, and FFPs were considered only in the context of what could be learned about them given this strategy. We derive a simple equation that mathematically expresses this conflict and explains why the current approach severely depresses detection of 2 of the 5 decades of potential FFP masses, i.e., exactly the two decades, $M_{\rm Pluto}< M <2\,M_{\rm Mars}$, that would tie terrestrial planets to the proto-planetary material out of which they formed. FFPs can be either truly free floating or can be bound in "Wide", "Kuiper", and "Oort" orbits, whose separate identification will allow further insight into planet formation. In the (low-mass) limit that the source radius is much bigger than the Einstein radius, $\theta_*\gg\theta_{\rm E}$, the number of significantly magnified points on the FFP light curve is $N=2\Gamma\theta_*\sqrt{1-z^2}/\mu$ --> 3.0, when normalized to the adopted Roman cadence $\Gamma=4/$hr, and to source radius $\theta_*=0.3\,\mu$as, lens-source proper motion $\mu=6\,$mas/yr, and source impact parameter $z=0.5$, which are all typical values. By contrast $N=6$ are needed for an FFP detection. Thus, unless $\Gamma$ is doubled, FFP detection will be driven into the (large-$\theta_*$, small-$\mu$) corner of parameter space, reducing the detections by a net factor of 2 and cutting off the lowest-mass FFPs.


title: RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold

abstract: Training on model-generated synthetic data is a promising approach for finetuning LLMs, but it remains unclear when it helps or hurts. In this paper, we investigate this question for math reasoning via an empirical study, followed by building a conceptual understanding of our observations. First, we find that while the typical approach of finetuning a model on synthetic correct or positive problem-solution pairs generated by capable models offers modest performance gains, sampling more correct solutions from the finetuned learner itself followed by subsequent fine-tuning on this self-generated data $\textbf{doubles}$ the efficiency of the same synthetic problems. At the same time, training on model-generated positives can amplify various spurious correlations, resulting in flat or even inverse scaling trends as the amount of data increases. Surprisingly, we find that several of these issues can be addressed if we also utilize negative responses, i.e., model-generated responses that are deemed incorrect by a final answer verifier. Crucially, these negatives must be constructed such that the training can appropriately recover the utility or advantage of each intermediate step in the negative response. With this per-step scheme, we are able to attain consistent gains over only positive data, attaining performance similar to amplifying the amount of synthetic data by $\mathbf{8 \times}$. We show that training on per-step negatives can help to unlearn spurious correlations in the positive data, and is equivalent to advantage-weighted reinforcement learning (RL), implying that it inherits robustness benefits of RL over imitating positive data alone.


title: Local symmetries in partially ordered sets

abstract: Partially ordered sets (posets) have a universal appearance as an abstract structure in many areas of mathematics. Though, even their explicit enumeration remains unknown in general, and only the counts of all partial orders on sets of up to 16 unlabelled elements have been calculated to date, see sequence A000112 in the OEIS. In this work, we study automorphisms of posets in order to formulate a classification by local symmetries. These symmetries give rise to a division operation on the set of all posets and lead us to the construction of symmetry classes that are easier to characterise and enumerate. Additionally to the enumeration of symmetry classes, I derive polynomial expressions that count certain subsets of posets with a large number of layers (a large height). As an application in physics, I investigate local symmetries (or rather their lack of) in causal sets, which are discrete spacetime models used as a candidate framework for quantum gravity.


title: Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registration

abstract: A comprehensive guidance view for cardiac interventional surgery can be provided by the real-time fusion of the intraoperative 2D images and preoperative 3D volume based on the ultrasound frame-to-volume registration. However, cardiac ultrasound images are characterized by a low signal-to-noise ratio and small differences between adjacent frames, coupled with significant dimension variations between 2D frames and 3D volumes to be registered, resulting in real-time and accurate cardiac ultrasound frame-to-volume registration being a very challenging task. This paper introduces a lightweight end-to-end Cardiac Ultrasound frame-to-volume Registration network, termed CU-Reg. Specifically, the proposed model leverages epicardium prompt-guided anatomical clues to reinforce the interaction of 2D sparse and 3D dense features, followed by a voxel-wise local-global aggregation of enhanced features, thereby boosting the cross-dimensional matching effectiveness of low-quality ultrasound modalities. We further embed an inter-frame discriminative regularization term within the hybrid supervised learning to increase the distinction between adjacent slices in the same ultrasound volume to ensure registration stability. Experimental results on the reprocessed CAMUS dataset demonstrate that our CU-Reg surpasses existing methods in terms of registration accuracy and efficiency, meeting the guidance requirements of clinical cardiac interventional surgery.


title: On estimation and order selection for multivariate extremes via clustering

abstract: We investigate the estimation of multivariate extreme models with a discrete spectral measure using spherical clustering techniques. The primary contribution involves devising a method for selecting the order, that is, the number of clusters. The method consistently identifies the true order, i.e., the number of spectral atoms, and enjoys intuitive implementation in practice. Specifically, we introduce an extra penalty term to the well-known simplified average silhouette width, which penalizes small cluster sizes and small dissimilarities between cluster centers. Consequently, we provide a consistent method for determining the order of a max-linear factor model, where a typical information-based approach is not viable. Our second contribution is a large-deviation-type analysis for estimating the discrete spectral measure through clustering methods, which serves as an assessment of the convergence quality of clustering-based estimation for multivariate extremes. Additionally, as a third contribution, we discuss how estimating the discrete measure can lead to parameter estimations of heavy-tailed factor models. We also present simulations and real-data studies that demonstrate order selection and factor model estimation.


title: Formulation of Chimera Gradient Flows for Chemotaxis Systems with Indirect Signal Production and Degenerate Diffusion

abstract: A parabolic system of three unknown functions, not expressible as gradient flows, is treated as three coupled gradient flows. For each unknown function, the minimizing movement scheme is used to construct a time-discrete approximate solution. Unlike standard minimizing movement scheme for gradient flows, the relative compactness of the time-discrete approximate solution with respect to the time step is not inherently guaranteed. However, the existence of a Lyapunov functional ensures this relative compactness, leading to the existence of time-global solutions.


title: MacroHFT: Memory Augmented Context-aware Reinforcement Learning On High Frequency Trading

abstract: High-frequency trading (HFT) that executes algorithmic trading in short time scales, has recently occupied the majority of cryptocurrency market. Besides traditional quantitative trading methods, reinforcement learning (RL) has become another appealing approach for HFT due to its terrific ability of handling high-dimensional financial data and solving sophisticated sequential decision-making problems, \emph{e.g.,} hierarchical reinforcement learning (HRL) has shown its promising performance on second-level HFT by training a router to select only one sub-agent from the agent pool to execute the current transaction. However, existing RL methods for HFT still have some defects: 1) standard RL-based trading agents suffer from the overfitting issue, preventing them from making effective policy adjustments based on financial context; 2) due to the rapid changes in market conditions, investment decisions made by an individual agent are usually one-sided and highly biased, which might lead to significant loss in extreme markets. To tackle these problems, we propose a novel Memory Augmented Context-aware Reinforcement learning method On HFT, \emph{a.k.a.} MacroHFT, which consists of two training phases: 1) we first train multiple types of sub-agents with the market data decomposed according to various financial indicators, specifically market trend and volatility, where each agent owns a conditional adapter to adjust its trading policy according to market conditions; 2) then we train a hyper-agent to mix the decisions from these sub-agents and output a consistently profitable meta-policy to handle rapid market fluctuations, equipped with a memory mechanism to enhance the capability of decision-making. Extensive experiments on various cryptocurrency markets demonstrate that MacroHFT can achieve state-of-the-art performance on minute-level trading tasks.


title: On the Burau representation of $B_3$ modulo $p$

abstract: We present an algorithm that, given a prime $p$ as input, determines whether or not the Burau representation of the 3-strand braid group modulo $p$ is faithful. We also prove that the representation is indeed faithful when $p\le 13$. Additionally, we re-pose Salter's question on the Burau representation of $B_3$ over finite fields $\mathbb{F}_p$, and solve it for every $p$.


title: Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Steps

abstract: Diffusion distillation represents a highly promising direction for achieving faithful text-to-image generation in a few sampling steps. However, despite recent successes, existing distilled models still do not provide the full spectrum of diffusion abilities, such as real image inversion, which enables many precise image manipulation methods. This work aims to enrich distilled text-to-image diffusion models with the ability to effectively encode real images into their latent space. To this end, we introduce invertible Consistency Distillation (iCD), a generalized consistency distillation framework that facilitates both high-quality image synthesis and accurate image encoding in only 3-4 inference steps. Though the inversion problem for text-to-image diffusion models gets exacerbated by high classifier-free guidance scales, we notice that dynamic guidance significantly reduces reconstruction errors without noticeable degradation in generation performance. As a result, we demonstrate that iCD equipped with dynamic guidance may serve as a highly effective tool for zero-shot text-guided image editing, competing with more expensive state-of-the-art alternatives.


title: IRASim: Learning Interactive Real-Robot Action Simulators

abstract: Scalable robot learning in the real world is limited by the cost and safety issues of real robots. In addition, rolling out robot trajectories in the real world can be time-consuming and labor-intensive. In this paper, we propose to learn an interactive real-robot action simulator as an alternative. We introduce a novel method, IRASim, which leverages the power of generative models to generate extremely realistic videos of a robot arm that executes a given action trajectory, starting from an initial given frame. To validate the effectiveness of our method, we create a new benchmark, IRASim Benchmark, based on three real-robot datasets and perform extensive experiments on the benchmark. Results show that IRASim outperforms all the baseline methods and is more preferable in human evaluations. We hope that IRASim can serve as an effective and scalable approach to enhance robot learning in the real world. To promote research for generative real-robot action simulators, we open-source code, benchmark, and checkpoints at https: //gen-irasim.github.io.


title: Are LLMs Naturally Good at Synthetic Tabular Data Generation?

abstract: Large language models (LLMs) have demonstrated their prowess in generating synthetic text and images; however, their potential for generating tabular data -- arguably the most common data type in business and scientific applications -- is largely underexplored. This paper demonstrates that LLMs, used as-is, or after traditional fine-tuning, are severely inadequate as synthetic table generators. Due to the autoregressive nature of LLMs, fine-tuning with random order permutation runs counter to the importance of modeling functional dependencies, and renders LLMs unable to model conditional mixtures of distributions (key to capturing real world constraints). We showcase how LLMs can be made to overcome some of these deficiencies by making them permutation-aware.


title: $\texttt{cunuSHT}$: GPU Accelerated Spherical Harmonic Transforms on Arbitrary Pixelizations

abstract: We present $\texttt{cunusht}$, a general-purpose Python package that wraps a highly efficient CUDA implementation of the nonuniform spin-$0$ spherical harmonic transform. The method is applicable to arbitrary pixelization schemes, including schemes constructed from equally-spaced iso-latitude rings as well as completely nonuniform ones. The algorithm has an asymptotic scaling of $\mathrm{O}{(\ell_{\rm max}^3)}$ for maximum multipole $\ell_{\rm max}$ and achieves machine precision accuracy. While $\texttt{cunusht}$ is developed for applications in cosmology in mind, it is applicable to various other interpolation problems on the sphere. We outperform the fastest available CPU algorithm by a factor of up to 5 for problems with a nonuniform pixelization and $\ell_{\rm max}>4\cdot10^3$ when comparing a single modern GPU to a modern 32-core CPU. This performance is achieved by utilizing the double Fourier sphere method in combination with the nonuniform fast Fourier transform and by avoiding transfers between the host and device. For scenarios without GPU availability, $\texttt{cunusht}$ wraps existing CPU libraries. $\texttt{cunusht}$ is publicly available and includes tests, documentation, and demonstrations.


title: Equivariant Vector Bundles with Connection on Drinfeld Symmetric Spaces

abstract: For a finite extension $F$ of $\mathbb{Q}_p$ and $n \geq 1$, let $D$ be the division algebra over $F$ of invariant $1/n$ and let $G^0$ be the subgroup of $\text{GL}_n(F)$ of elements with norm $1$ determinant. We show that the action of $D^\times$ on the Drinfeld tower induces an equivalence of categories from finite dimensional smooth representations of $D^\times$ to $G^0$-finite $\text{GL}_n(F)$-equivariant vector bundles with connection on $\Omega$, the $(n-1)$-dimensional Drinfeld symmetric space.


title: Prism: A Framework for Decoupling and Assessing the Capabilities of VLMs

abstract: Vision Language Models (VLMs) demonstrate remarkable proficiency in addressing a wide array of visual questions, which requires strong perception and reasoning faculties. Assessing these two competencies independently is crucial for model refinement, despite the inherent difficulty due to the intertwined nature of seeing and reasoning in existing VLMs. To tackle this issue, we present Prism, an innovative framework designed to disentangle the perception and reasoning processes involved in visual question solving. Prism comprises two distinct stages: a perception stage that utilizes a VLM to extract and articulate visual information in textual form, and a reasoning stage that formulates responses based on the extracted visual information using a Large Language Model (LLM). This modular design enables the systematic comparison and assessment of both proprietary and open-source VLM for their perception and reasoning strengths. Our analytical framework provides several valuable insights, underscoring Prism's potential as a cost-effective solution for vision-language tasks. By combining a streamlined VLM focused on perception with a powerful LLM tailored for reasoning, Prism achieves superior results in general vision-language tasks while substantially cutting down on training and operational expenses. Quantitative evaluations show that Prism, when configured with a vanilla 2B LLaVA and freely accessible GPT-3.5, delivers performance on par with VLMs $10 \times$ larger on the rigorous multimodal benchmark MMStar. The project is released at: https://github.com/SparksJoe/Prism.


title: Unmasking Database Vulnerabilities: Zero-Knowledge Schema Inference Attacks in Text-to-SQL Systems

abstract: Relational databases are integral to modern information systems, serving as the foundation for storing, querying, and managing data efficiently and effectively. Advancements in large language modeling have led to the emergence of text-to-SQL technologies, significantly enhancing the querying and extracting of information from these databases and raising concerns about privacy and security. Our research extracts the database schema elements underlying a text-to-SQL model. Knowledge of the schema can make attacks such as SQL injection easier. By asking specially crafted questions, we have developed a zero-knowledge framework designed to probe various database schema elements without knowledge of the database itself. The text-to-SQL models then process these questions to produce an output that we use to uncover the structure of the database schema. We apply it to specialized text-to-SQL models fine-tuned on text-SQL pairs and generative language models used for SQL generation. Overall, we can reconstruct the table names with an F1 of nearly .75 for fine-tuned models and .96 for generative.


title: Connecting the Dots: LLMs can Infer and Verbalize Latent Structure from Disparate Training Data

abstract: One way to address safety risks from large language models (LLMs) is to censor dangerous knowledge from their training data. While this removes the explicit information, implicit information can remain scattered across various training documents. Could an LLM infer the censored knowledge by piecing together these implicit hints? As a step towards answering this question, we study inductive out-of-context reasoning (OOCR), a type of generalization in which LLMs infer latent information from evidence distributed across training documents and apply it to downstream tasks without in-context learning. Using a suite of five tasks, we demonstrate that frontier LLMs can perform inductive OOCR. In one experiment we finetune an LLM on a corpus consisting only of distances between an unknown city and other known cities. Remarkably, without in-context examples or Chain of Thought, the LLM can verbalize that the unknown city is Paris and use this fact to answer downstream questions. Further experiments show that LLMs trained only on individual coin flip outcomes can verbalize whether the coin is biased, and those trained only on pairs $(x,f(x))$ can articulate a definition of $f$ and compute inverses. While OOCR succeeds in a range of cases, we also show that it is unreliable, particularly for smaller LLMs learning complex structures. Overall, the ability of LLMs to "connect the dots" without explicit in-context learning poses a potential obstacle to monitoring and controlling the knowledge acquired by LLMs.


title: A Mathematical Definition of Path Integrals on Symplectic Manifolds

abstract: We give a mathematical definition of some path integrals, emphasizing those relevant to the quantization of symplectic manifolds (and more generally, Poisson manifolds) $\unicode{x2013}$ in particular, the coherent state path integral. We show that K\"{a}hler manifolds provide many computable examples.


title: Consistency Models Made Easy

abstract: Consistency models (CMs) are an emerging class of generative models that offer faster sampling than traditional diffusion models. CMs enforce that all points along a sampling trajectory are mapped to the same initial point. But this target leads to resource-intensive training: for example, as of 2024, training a SoTA CM on CIFAR-10 takes one week on 8 GPUs. In this work, we propose an alternative scheme for training CMs, vastly improving the efficiency of building such models. Specifically, by expressing CM trajectories via a particular differential equation, we argue that diffusion models can be viewed as a special case of CMs with a specific discretization. We can thus fine-tune a consistency model starting from a pre-trained diffusion model and progressively approximate the full consistency condition to stronger degrees over the training process. Our resulting method, which we term Easy Consistency Tuning (ECT), achieves vastly improved training times while indeed improving upon the quality of previous methods: for example, ECT achieves a 2-step FID of 2.73 on CIFAR10 within 1 hour on a single A100 GPU, matching Consistency Distillation trained of hundreds of GPU hours. Owing to this computational efficiency, we investigate the scaling law of CMs under ECT, showing that they seem to obey classic power law scaling, hinting at their ability to improve efficiency and performance at larger scales. Code (https://github.com/locuslab/ect) is available.


title: Uncovering Latent Memories: Assessing Data Leakage and Memorization Patterns in Large Language Models

abstract: The proliferation of large language models has revolutionized natural language processing tasks, yet it raises profound concerns regarding data privacy and security. Language models are trained on extensive corpora including potentially sensitive or proprietary information, and the risk of data leakage -- where the model response reveals pieces of such information -- remains inadequately understood. This study examines susceptibility to data leakage by quantifying the phenomenon of memorization in machine learning models, focusing on the evolution of memorization patterns over training. We investigate how the statistical characteristics of training data influence the memories encoded within the model by evaluating how repetition influences memorization. We reproduce findings that the probability of memorizing a sequence scales logarithmically with the number of times it is present in the data. Furthermore, we find that sequences which are not apparently memorized after the first encounter can be uncovered throughout the course of training even without subsequent encounters. The presence of these latent memorized sequences presents a challenge for data privacy since they may be hidden at the final checkpoint of the model. To this end, we develop a diagnostic test for uncovering these latent memorized sequences by considering their cross entropy loss.


title: GraphReader: Building Graph-based Agent to Enhance Long-Context Abilities of Large Language Models

abstract: Long-context capabilities are essential for large language models (LLMs) to tackle complex and long-input tasks. Despite numerous efforts made to optimize LLMs for long contexts, challenges persist in robustly processing long inputs. In this paper, we introduce GraphReader, a graph-based agent system designed to handle long texts by structuring them into a graph and employing an agent to explore this graph autonomously. Upon receiving a question, the agent first undertakes a step-by-step analysis and devises a rational plan. It then invokes a set of predefined functions to read node content and neighbors, facilitating a coarse-to-fine exploration of the graph. Throughout the exploration, the agent continuously records new insights and reflects on current circumstances to optimize the process until it has gathered sufficient information to generate an answer. Experimental results on the LV-Eval dataset reveal that GraphReader, using a 4k context window, consistently outperforms GPT-4-128k across context lengths from 16k to 256k by a large margin. Additionally, our approach demonstrates superior performance on four challenging single-hop and multi-hop benchmarks.


title: Advancing Fine-Grained Classification by Structure and Subject Preserving Augmentation

abstract: Fine-grained visual classification (FGVC) involves classifying closely related sub-classes. This task is difficult due to the subtle differences between classes and the high intra-class variance. Moreover, FGVC datasets are typically small and challenging to gather, thus highlighting a significant need for effective data augmentation. Recent advancements in text-to-image diffusion models offer new possibilities for augmenting classification datasets. While these models have been used to generate training data for classification tasks, their effectiveness in full-dataset training of FGVC models remains under-explored. Recent techniques that rely on Text2Image generation or Img2Img methods, often struggle to generate images that accurately represent the class while modifying them to a degree that significantly increases the dataset's diversity. To address these challenges, we present SaSPA: Structure and Subject Preserving Augmentation. Contrary to recent methods, our method does not use real images as guidance, thereby increasing generation flexibility and promoting greater diversity. To ensure accurate class representation, we employ conditioning mechanisms, specifically by conditioning on image edges and subject representation. We conduct extensive experiments and benchmark SaSPA against both traditional and recent generative data augmentation methods. SaSPA consistently outperforms all established baselines across multiple settings, including full dataset training, contextual bias, and few-shot classification. Additionally, our results reveal interesting patterns in using synthetic data for FGVC models; for instance, we find a relationship between the amount of real data used and the optimal proportion of synthetic data. Code is available at https://github.com/EyalMichaeli/SaSPA-Aug.


title: Exploring the no-hair theorem with LISA

abstract: In this study, we explore the possibility of testing the no-hair theorem with gravitational waves from massive black hole binaries in the frequency band of the Laser Interferometer Space Antenna (LISA). Based on its sensitivity, we consider LISA's ability to detect possible deviations from general relativity (GR) in the ringdown. Two approaches are considered: an agnostic quasi-normal mode (QNM) analysis, and a method explicitly targeting the deviations from GR for given QNMs. Both approaches allow us to find fractional deviations from general relativity as estimated parameters or by comparing the mass and spin estimated from different QNMs. However, depending on whether we rely on the prior knowledge of the source parameters from a pre-merger or inspiral-merger-ringdown (IMR) analysis, the estimated deviations may vary. Under some assumptions, the second approach targeting fractional deviations from GR allows us to recover the injected values with high accuracy and precision. We obtain $(5\%, 10\%)$ uncertainty on ($\delta \omega, \delta \tau)$ for the $(3,3,0)$ mode, and $(3\%, 17\%)$ for the $(4,4,0)$ mode. As each approach constrains different features, we conclude that combining both methods would be necessary to perform a better test. In this analysis, we also forecast the precision of the estimated deviation parameters for sources throughout the mass and distance ranges observable by LISA.


title: xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics

abstract: State-of-the-art trainable machine translation evaluation metrics like xCOMET achieve high correlation with human judgment but rely on large encoders (up to 10.7B parameters), making them computationally expensive and inaccessible to researchers with limited resources. To address this issue, we investigate whether the knowledge stored in these large encoders can be compressed while maintaining quality. We employ distillation, quantization, and pruning techniques to create efficient xCOMET alternatives and introduce a novel data collection pipeline for efficient black-box distillation. Our experiments show that, using quantization, xCOMET can be compressed up to three times with no quality degradation. Additionally, through distillation, we create an xCOMET-lite metric, which has only 2.6% of xCOMET-XXL parameters, but retains 92.1% of its quality. Besides, it surpasses strong small-scale metrics like COMET-22 and BLEURT-20 on the WMT22 metrics challenge dataset by 6.4%, despite using 50% fewer parameters. All code, dataset, and models are available online.


title: Neutrino mass bounds from DESI 2024 are relaxed by Planck PR4 and cosmological supernovae

abstract: The recent DESI 2024 Baryon Acoustic Oscillations (BAO) measurements combined with the CMB data from the Planck 18 PR3 dataset and the Planck PR4+ACT DR6 lensing data, with a prior on the sum of the neutrino masses $\sum m_\nu>0$, leads to a strong constraint, $\sum m_\nu<0.072$ eV, which would exclude the inverted neutrino hierarchy and put some tension on even the standard hierarchy. We show that actually this bound gets significantly relaxed when combining the new DESI measurements with the HiLLiPoP+LoLLiPoP likelihoods, based on the Planck 2020 PR4 dataset, and with supernovae datasets. We note that the fact that neutrino masses are pushed towards zero, and even towards negative values, is known to be correlated with the so-called $A_L$ tension, a mismatch between lensing and power spectrum measurements in the Planck PR3 data, which is reduced by HiLLiPoP+LoLLiPoP to less than 1$\sigma$. We find $\sum m_\nu<0.1$ eV and $\sum m_\nu<0.12$ eV, with the supernovae Pantheon+ and DES-SN5YR datasets respectively. The shift caused by these datasets is more compatible with the expectations from neutrino oscillation experiments, and both the normal and inverted hierarchy scenarios remain now viable, even with the $\sum m_\nu>0$ prior. Finally, we analyze neutrino mass bounds in an extension of $\Lambda$CDM that addresses the $H_0$ tension, with extra fluid Dark Radiation, finding that in such models bounds are further relaxed and the posterior probability for $\sum m_\nu$ begins to exhibit a peak at positive values.


title: A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Models

abstract: Image editing aims to edit the given synthetic or real image to meet the specific requirements from users. It is widely studied in recent years as a promising and challenging field of Artificial Intelligence Generative Content (AIGC). Recent significant advancement in this field is based on the development of text-to-image (T2I) diffusion models, which generate images according to text prompts. These models demonstrate remarkable generative capabilities and have become widely used tools for image editing. T2I-based image editing methods significantly enhance editing performance and offer a user-friendly interface for modifying content guided by multimodal inputs. In this survey, we provide a comprehensive review of multimodal-guided image editing techniques that leverage T2I diffusion models. First, we define the scope of image editing from a holistic perspective and detail various control signals and editing scenarios. We then propose a unified framework to formalize the editing process, categorizing it into two primary algorithm families. This framework offers a design space for users to achieve specific goals. Subsequently, we present an in-depth analysis of each component within this framework, examining the characteristics and applicable scenarios of different combinations. Given that training-based methods learn to directly map the source image to target one under user guidance, we discuss them separately, and introduce injection schemes of source image in different scenarios. Additionally, we review the application of 2D techniques to video editing, highlighting solutions for inter-frame inconsistency. Finally, we discuss open challenges in the field and suggest potential future research directions. We keep tracing related works at https://github.com/xinchengshuai/Awesome-Image-Editing.


title: Asynchronous Large Language Model Enhanced Planner for Autonomous Driving

abstract: Despite real-time planners exhibiting remarkable performance in autonomous driving, the growing exploration of Large Language Models (LLMs) has opened avenues for enhancing the interpretability and controllability of motion planning. Nevertheless, LLM-based planners continue to encounter significant challenges, including elevated resource consumption and extended inference times, which pose substantial obstacles to practical deployment. In light of these challenges, we introduce AsyncDriver, a new asynchronous LLM-enhanced closed-loop framework designed to leverage scene-associated instruction features produced by LLM to guide real-time planners in making precise and controllable trajectory predictions. On one hand, our method highlights the prowess of LLMs in comprehending and reasoning with vectorized scene data and a series of routing instructions, demonstrating its effective assistance to real-time planners. On the other hand, the proposed framework decouples the inference processes of the LLM and real-time planners. By capitalizing on the asynchronous nature of their inference frequencies, our approach have successfully reduced the computational cost introduced by LLM, while maintaining comparable performance. Experiments show that our approach achieves superior closed-loop evaluation performance on nuPlan's challenging scenarios.


title: Generalized upwind summation-by-parts operators and their application to nodal discontinuous Galerkin methods

abstract: There is a pressing demand for robust, high-order baseline schemes for conservation laws that minimize reliance on supplementary stabilization. In this work, we respond to this demand by developing new baseline schemes within a nodal discontinuous Galerkin (DG) framework, utilizing upwind summation-by-parts (USBP) operators and flux vector splittings. To this end, we demonstrate the existence of USBP operators on arbitrary grid points and provide a straightforward procedure for their construction. Our method encompasses a broader class of USBP operators, not limited to equidistant grid points. This approach facilitates the development of novel USBP operators on Legendre--Gauss--Lobatto (LGL) points, which are suited for nodal discontinuous Galerkin (DG) methods. The resulting DG-USBP operators combine the strengths of traditional summation-by-parts (SBP) schemes with the benefits of upwind discretizations, including inherent dissipation mechanisms. Through numerical experiments, ranging from one-dimensional convergence tests to multi-dimensional curvilinear and under-resolved flow simulations, we find that DG-USBP operators, when integrated with flux vector splitting methods, foster more robust baseline schemes without excessive artificial dissipation.


title: CooHOI: Learning Cooperative Human-Object Interaction with Manipulated Object Dynamics

abstract: Recent years have seen significant advancements in humanoid control, largely due to the availability of large-scale motion capture data and the application of reinforcement learning methodologies. However, many real-world tasks, such as moving large and heavy furniture, require multi-character collaboration. Given the scarcity of data on multi-character collaboration and the efficiency challenges associated with multi-agent learning, these tasks cannot be straightforwardly addressed using training paradigms designed for single-agent scenarios. In this paper, we introduce Cooperative Human-Object Interaction (CooHOI), a novel framework that addresses multi-character objects transporting through a two-phase learning paradigm: individual skill acquisition and subsequent transfer. Initially, a single agent learns to perform tasks using the Adversarial Motion Priors (AMP) framework. Following this, the agent learns to collaborate with others by considering the shared dynamics of the manipulated object during parallel training using Multi Agent Proximal Policy Optimization (MAPPO). When one agent interacts with the object, resulting in specific object dynamics changes, the other agents learn to respond appropriately, thereby achieving implicit communication and coordination between teammates. Unlike previous approaches that relied on tracking-based methods for multi-character HOI, CooHOI is inherently efficient, does not depend on motion capture data of multi-character interactions, and can be seamlessly extended to include more participants and a wide range of object types


title: Disentangled Representation Learning for Environment-agnostic Speaker Recognition

abstract: This work presents a framework based on feature disentanglement to learn speaker embeddings that are robust to environmental variations. Our framework utilises an auto-encoder as a disentangler, dividing the input speaker embedding into components related to the speaker and other residual information. We employ a group of objective functions to ensure that the auto-encoder's code representation - used as the refined embedding - condenses only the speaker characteristics. We show the versatility of our framework through its compatibility with any existing speaker embedding extractor, requiring no structural modifications or adaptations for integration. We validate the effectiveness of our framework by incorporating it into two popularly used embedding extractors and conducting experiments across various benchmarks. The results show a performance improvement of up to 16%. We release our code for this work to be available https://github.com/kaistmm/voxceleb-disentangler


title: OH mid-infrared emission as a diagnostic of H$_2$O UV photodissociation. III. Application to planet-forming disks

abstract: JWST gives a unique access to the physical and chemical structure of inner disks ($<10$~au), where the majority of the planets are forming. However, the interpretation of mid-infrared (mid-IR) spectra requires detailed thermo-chemical models able to provide synthetic spectra readily comparable to spectroscopic observations. Our goal is to explore the potential of mid-IR emission of OH to probe H$_2$O photodissociation. We include in the DALI disk model prompt emission of OH following photodissociation of H$_2$O in its $\tilde{B}$ electronic state ($\lambda < 144$~nm). This model allows to compute in a self-consistent manner the thermo-chemical structure of the disk and the resulting mid-IR line intensities of OH and H$_2$O. The OH line intensities in the $9-13~\mu$m range are proportional to the total amount of water photodissociated. As such, these lines are a tracer of the amount of water exposed to the FUV field, which depends on the temperature, density, and strength of the FUV field reaching the upper molecular layers. In particular, the OH line fluxes primarily scale with the FUV field emitted by the star in contrast with H$_2$O lines in the 10-20$~\mu$m range which scale with the bolometric luminosity. OH is therefore a key diagnostic to probe the effect of Ly$\alpha$ and constrain the dust FUV opacity in the upper molecular layers. A strong asymmetry between the A' and A'' components of each rotational quadruplet is also predicted. OH mid-IR emission is a powerful tool to probe H$_2$O photodissociation and infer the physical conditions in disk atmospheres. As such, the inclusion of OH mid-IR lines in the analysis of JWST-MIRI spectra will be key for robustly inferring the composition of planet-forming disks. The interpretation of less excited OH lines requires additional quantum calculations of the formation pumping of OH levels by O+H$_2$ and the collisional rate coefficients.


title: How to Compute the Probability of a Word

abstract: Language models (LMs) estimate the probability distribution over sequences of natural language; these distributions are crucial for computing perplexity and surprisal in linguistics research. While we are usually concerned with measuring these values for words, most LMs operate over subwords. Despite seemingly straightforward, accurately computing probabilities over one unit given probabilities over the other requires care. Indeed, we show here that many recent linguistic studies have been incorrectly computing these values. This paper derives the correct methods for computing word probabilities, highlighting issues when relying on language models that use beginning-of-word (bow)-marking tokenisers, e.g., the GPT family. Empirically, we show that correcting the widespread bug in probability computations affects measured outcomes in sentence comprehension and lexical optimisation analyses.


title: Whiteboard-of-Thought: Thinking Step-by-Step Across Modalities

abstract: When presented with questions involving visual thinking, humans naturally switch reasoning modalities, often forming mental images or drawing visual aids. Large language models have shown promising results in arithmetic and symbolic reasoning by expressing intermediate reasoning in text as a chain of thought, yet struggle to extend this capability to answer text queries that are easily solved by visual reasoning, even with extensive multimodal pretraining. We introduce a simple method, whiteboard-of-thought prompting, to unlock the visual reasoning capabilities of multimodal large language models across modalities. Whiteboard-of-thought prompting provides multimodal large language models with a metaphorical `whiteboard' to draw out reasoning steps as images, then returns these images back to the model for further processing. We find this can be accomplished with no demonstrations or specialized modules, instead leveraging models' existing ability to write code with libraries such as Matplotlib and Turtle. This simple approach shows state-of-the-art results on four difficult natural language tasks that involve visual and spatial reasoning. We identify multiple settings where GPT-4o using chain-of-thought fails dramatically, including more than one where it achieves $0\%$ accuracy, while whiteboard-of-thought enables up to $92\%$ accuracy in these same settings. We present a detailed exploration of where the technique succeeds as well as its sources of error.


title: Model Merging and Safety Alignment: One Bad Model Spoils the Bunch

abstract: Merging Large Language Models (LLMs) is a cost-effective technique for combining multiple expert LLMs into a single versatile model, retaining the expertise of the original ones. However, current approaches often overlook the importance of safety alignment during merging, leading to highly misaligned models. This work investigates the effects of model merging on alignment. We evaluate several popular model merging techniques, demonstrating that existing methods do not only transfer domain expertise but also propagate misalignment. We propose a simple two-step approach to address this problem: (i) generating synthetic safety and domain-specific data, and (ii) incorporating these generated data into the optimization process of existing data-aware model merging techniques. This allows us to treat alignment as a skill that can be maximized in the resulting merged LLM. Our experiments illustrate the effectiveness of integrating alignment-related data during merging, resulting in models that excel in both domain expertise and alignment.


title: Phase distribution in 1D localization and phase transitions in single-mode waveguides

abstract: Localization of electrons in 1D disordered systems is usually described in the random phase approximation, when distributions of phases \varphi and \theta, entering the transfer matrix, are considered as uniform. In the general case, the random phase approximation is violated, and the evolution equations (when the system length L is increased) contain three independent variables, i.e. the Landauer resistance \rho and the combined phases \psi=\theta-\varphi and \chi=\theta+\varphi. The phase \chi does not affect the evolution of \rho and was not considered in previous papers. The distribution of the phase \psi is found to exhibit an unusual phase transition at the point E_0 when changing the electron energy E, which manifests itself in the appearance of the imaginary part of \psi. The distribution of resistance P(\rho) has no singularity at the point E_0, and the transition looks unobservable in the electron disordered systems. However, the theory of 1D localization is immediately applicable to propagation of waves in single-mode optical waveguides. The optical methods are more efficient and provide possibility to measure phases \psi and \chi. On the one hand, it makes observable the phase transition in the distribution P(\psi), which can be considered as a 'trace' of the mobility edge remaining in 1D systems. On the other hand, observability of the phase \chi makes actual derivation of its evolution equation, which is presented below. Relaxation of the distribution P(\chi) to the limiting distribution P_\infty(\chi) at L\to\infty is described by two exponents, whose exponentials have jumps of the second derivative, when the energy E is changed.

categories: cond-mat.dis-nn cond-mat.mes-hall cond-mat.stat-mech physics.optics


title: ReflectanceFusion: Diffusion-based text to SVBRDF Generation

abstract: We introduce Reflectance Diffusion, a new neural text-to-texture model capable of generating high-fidelity SVBRDF maps from textual descriptions. Our method leverages a tandem neural approach, consisting of two modules, to accurately model the distribution of spatially varying reflectance as described by text prompts. Initially, we employ a pre-trained stable diffusion 2 model to generate a latent representation that informs the overall shape of the material and serves as our backbone model. Then, our ReflectanceUNet enables fine-tuning control over the material's physical appearance and generates SVBRDF maps. ReflectanceUNet module is trained on an extensive dataset comprising approximately 200,000 synthetic spatially varying materials. Our generative SVBRDF diffusion model allows for the synthesis of multiple SVBRDF estimates from a single textual input, offering users the possibility to choose the output that best aligns with their requirements. We illustrate our method's versatility by generating SVBRDF maps from a range of textual descriptions, both specific and broad. Our ReflectanceUNet model can integrate optional physical parameters, such as roughness and specularity, enhancing customization. When the backbone module is fixed, the ReflectanceUNet module refines the material, allowing direct edits to its physical attributes. Comparative evaluations demonstrate that ReflectanceFusion achieves better accuracy than existing text-to-material models, such as Text2Mat, while also providing the benefits of editable and relightable SVBRDF maps.


title: LM-IGTD: a 2D image generator for low-dimensional and mixed-type tabular data to leverage the potential of convolutional neural networks

abstract: Tabular data have been extensively used in different knowledge domains. Convolutional neural networks (CNNs) have been successfully used in many applications where important information about data is embedded in the order of features (images), outperforming predictive results of traditional models. Recently, several researchers have proposed transforming tabular data into images to leverage the potential of CNNs and obtain high results in predictive tasks such as classification and regression. In this paper, we present a novel and effective approach for transforming tabular data into images, addressing the inherent limitations associated with low-dimensional and mixed-type datasets. Our method, named Low Mixed-Image Generator for Tabular Data (LM-IGTD), integrates a stochastic feature generation process and a modified version of the IGTD. We introduce an automatic and interpretable end-to-end pipeline, enabling the creation of images from tabular data. A mapping between original features and the generated images is established, and post hoc interpretability methods are employed to identify crucial areas of these images, enhancing interpretability for predictive tasks. An extensive evaluation of the tabular-to-image generation approach proposed on 12 low-dimensional and mixed-type datasets, including binary and multi-class classification scenarios. In particular, our method outperformed all traditional ML models trained on tabular data in five out of twelve datasets when using images generated with LM-IGTD and CNN. In the remaining datasets, LM-IGTD images and CNN consistently surpassed three out of four traditional ML models, achieving similar results to the fourth model.


title: DragPoser: Motion Reconstruction from Variable Sparse Tracking Signals via Latent Space Optimization

abstract: High-quality motion reconstruction that follows the user's movements can be achieved by high-end mocap systems with many sensors. However, obtaining such animation quality with fewer input devices is gaining popularity as it brings mocap closer to the general public. The main challenges include the loss of end-effector accuracy in learning-based approaches, or the lack of naturalness and smoothness in IK-based solutions. In addition, such systems are often finely tuned to a specific number of trackers and are highly sensitive to missing data e.g., in scenarios where a sensor is occluded or malfunctions. In response to these challenges, we introduce DragPoser, a novel deep-learning-based motion reconstruction system that accurately represents hard and dynamic on-the-fly constraints, attaining real-time high end-effectors position accuracy. This is achieved through a pose optimization process within a structured latent space. Our system requires only one-time training on a large human motion dataset, and then constraints can be dynamically defined as losses, while the pose is iteratively refined by computing the gradients of these losses within the latent space. To further enhance our approach, we incorporate a Temporal Predictor network, which employs a Transformer architecture to directly encode temporality within the latent space. This network ensures the pose optimization is confined to the manifold of valid poses and also leverages past pose data to predict temporally coherent poses. Results demonstrate that DragPoser surpasses both IK-based and the latest data-driven methods in achieving precise end-effector positioning, while it produces natural poses and temporally coherent motion. In addition, our system showcases robustness against on-the-fly constraint modifications, and exhibits exceptional adaptability to various input configurations and changes.


title: Policy Gradient-Driven Noise Mask

abstract: Deep learning classifiers face significant challenges when dealing with heterogeneous multi-modal and multi-organ biomedical datasets. The low-level feature distinguishability limited to imaging-modality hinders the classifiers' ability to learn high-level semantic relationships, resulting in sub-optimal performance. To address this issue, image augmentation strategies are employed as regularization techniques. While additive noise input during network training is a well-established augmentation as regularization method, modern pipelines often favor more robust techniques such as dropout and weight decay. This preference stems from the observation that combining these established techniques with noise input can adversely affect model performance. In this study, we propose a novel pretraining pipeline that learns to generate conditional noise mask specifically tailored to improve performance on multi-modal and multi-organ datasets. As a reinforcement learning algorithm, our approach employs a dual-component system comprising a very light-weight policy network that learns to sample conditional noise using a differentiable beta distribution and a classifier network. The policy network is trained using the reinforce algorithm to generate image-specific noise masks that regularize the classifier during pretraining. A key aspect is that the policy network's role is limited to obtaining an intermediate (or heated) model before fine-tuning. During inference, the policy network is omitted, allowing direct comparison between the baseline and noise-regularized models. We conducted experiments and related analyses on RadImageNet datasets. Results demonstrate that fine-tuning the intermediate models consistently outperforms conventional training algorithms on both classification and generalization to unseen concept tasks.


title: The optimization of paths in the $R^{3,1}$ space time by Markov Chain Monte Carlos

abstract: We propose a method to obtain the optimal weight function of 9 paths in (3+1)D space-time whose length is less than or equal to $2\times (6+2)$ lattice units. The factor 2 comes from inclusion of opposite direction path or time reversed paths. There are $2\times 2$ time shifts, which we assume that they can be regarded as stochastic Markov processes. We prepare the input 9D vector ${\bf X}$ and a $9\times 9$ matrix ${\bf W}$ and a bias vector ${\bf b}$, and consider affine transformations ${\bf Z}^{(h)}={\bf X}^{(in)}{\bf W}^{(h)T}+{\bf b}^{(h)}$ and ${\bf A}^{(h)}=\sigma({\bf Z}^{(h)})$ from an input layer to a hidden layer, the hidden layer to another hidden layer and from the hidden layer to an output layer, using the transformation ${\bf Z}^{(x)}={\bf A}^{(h)}{\bf W}^{(out) T} +{\bf b}^{(x)}$ and ${\bf A}^{(x)}=\sigma({\bf Z}^{(x)})$. By choosing the matrix ${\bf W}$ a diagonal matrix, and introducing the information of action of the 9 paths, a simple Monte Carlo simulation yields actions on a 2D plane spanned by $e_1, e_2$ for a fixed $u_2=j_2 e_2$ as a function of $u_1=j_1 e_1$. The action at high momentum region has small fluctuations, but at small momentum region, has large fluctuation. Generalizing $\bf W$ including mixing of paths, we search the optimal weight function using the Machine Learning (ML) techniques. For fixed point actions, actions of the output layer are defined by the output of final hidden layer


title: Deep-Learning Approach for Tissue Classification using Acoustic Waves during Ablation with an Er:YAG Laser (Updated)

abstract: Today's mechanical tools for bone cutting (osteotomy) cause mechanical trauma that prolongs the healing process. Medical device manufacturers aim to minimize this trauma, with minimally invasive surgery using laser cutting as one innovation. This method ablates tissue using laser light instead of mechanical tools, reducing post-surgery healing time. A reliable feedback system is crucial during laser surgery to prevent damage to surrounding tissues. We propose a tissue classification method analyzing acoustic waves generated during laser ablation, demonstrating its applicability in an ex-vivo experiment. The ablation process with a microsecond pulsed Er:YAG laser produces acoustic waves, acquired with an air-coupled transducer. These waves were used to classify five porcine tissue types: hard bone, soft bone, muscle, fat, and skin. For automated tissue classification, we compared five Neural Network (NN) approaches: a one-dimensional Convolutional Neural Network (CNN) with time-dependent input, a Fully-connected Neural Network (FcNN) with either the frequency spectrum or principal components of the frequency spectrum as input, and a combination of a CNN and an FcNN with time-dependent data and its frequency spectrum as input. Consecutive acoustic waves were used to improve classification accuracy. Grad-Cam identified the activation map of the frequencies, showing low frequencies as the most important for this task. Our results indicated that combining time-dependent data with its frequency spectrum achieved the highest classification accuracy (65.5%-75.5%). We also found that using the frequency spectrum alone was sufficient, with no additional benefit from applying Principal Components Analysis (PCA).


title: PreSto: An In-Storage Data Preprocessing System for Training Recommendation Models

abstract: Training recommendation systems (RecSys) faces several challenges as it requires the "data preprocessing" stage to preprocess an ample amount of raw data and feed them to the GPU for training in a seamless manner. To sustain high training throughput, state-of-the-art solutions reserve a large fleet of CPU servers for preprocessing which incurs substantial deployment cost and power consumption. Our characterization reveals that prior CPU-centric preprocessing is bottlenecked on feature generation and feature normalization operations as it fails to reap out the abundant inter-/intra-feature parallelism in RecSys preprocessing. PreSto is a storage-centric preprocessing system leveraging In-Storage Processing (ISP), which offloads the bottlenecked preprocessing operations to our ISP units. We show that PreSto outperforms the baseline CPU-centric system with a $9.6\times$ speedup in end-to-end preprocessing time, $4.3\times$ enhancement in cost-efficiency, and $11.3\times$ improvement in energyefficiency on average for production-scale RecSys preprocessing.


title: Bioptic -- A Target-Agnostic Efficacy-Based Small Molecules Search Engine

abstract: Recent successes in virtual screening have been made possible by large models and extensive chemical libraries. However, combining these elements is challenging: the larger the model, the more expensive it is to run, making ultra-large libraries unfeasible. To address this, we developed a target-agnostic, efficacy-based molecule search model, which allows us to find structurally dissimilar molecules with similar biological activities. We used the best practices to design fast retrieval system, based on processor-optimized SIMD instructions, enabling us to screen the ultra-large 40B Enamine REAL library with 100\% recall rate. We extensively benchmarked our model and several state-of-the-art models for both speed performance and retrieval quality of novel molecules.


title: Manufactured Solutions for an Electromagnetic Slot Model

abstract: The accurate modeling of electromagnetic penetration is an important topic in computational electromagnetics. Electromagnetic penetration occurs through intentional or inadvertent openings in an enclosed electromagnetic scatterer, which prevent the contents from being fully shielded from external fields. To efficiently model electromagnetic penetration, aperture or slot models can be used with surface integral equations to solve Maxwell's equations. A necessary step towards establishing the credibility of these models is to assess the correctness of the implementation of the underlying numerical methods through code verification. Surface integral equations and slot models yield multiple interacting sources of numerical error and other challenges, which render traditional code-verification approaches ineffective. In this paper, we provide approaches to separately measure the numerical errors arising from these different error sources for the method-of-moments implementation of the electric-field integral equation with a slot model. We demonstrate the effectiveness of these approaches for a variety of cases.


title: CMDS: Cross-layer Dataflow Optimization for DNN Accelerators Exploiting Multi-bank Memories

abstract: Deep neural networks (DNN) use a wide range of network topologies to achieve high accuracy within diverse applications. This model diversity makes it impossible to identify a single "dataflow" (execution schedule) to perform optimally across all possible layers and network topologies. Several frameworks support the exploration of the best dataflow for a given DNN layer and hardware. However, switching the dataflow from one layer to the next layer within one DNN model can result in hardware inefficiencies stemming from memory data layout mismatch among the layers. Unfortunately, all existing frameworks treat each layer independently and typically model memories as black boxes (one large monolithic wide memory), which ignores the data layout and can not deal with the data layout dependencies of sequential layers. These frameworks are not capable of doing dataflow cross-layer optimization. This work, hence, aims at cross-layer dataflow optimization, taking the data dependency and data layout reshuffling overheads among layers into account. Additionally, we propose to exploit the multibank memories typically present in modern DNN accelerators towards efficiently reshuffling data to support more dataflow at low overhead. These innovations are supported through the Cross-layer Memory-aware Dataflow Scheduler (CMDS). CMDS can model DNN execution energy/latency while considering the different data layout requirements due to the varied optimal dataflow of layers. Compared with the state-of-the-art (SOTA), which performs layer-optimized memory-unaware scheduling, CMDS achieves up to 5.5X energy reduction and 1.35X latency reduction with negligible hardware cost.


title: Theory of Turbulence for $d \rightarrow \infty$: Four-Loop Approximation of the Renormalization Group

abstract: Within the framework of the renormalization group approach in the stochastic model of fully developed turbulence, the $\beta$-function has been calculated in the fourth order of perturbation theory for high-dimensional spaces $d \rightarrow \infty$. The position of the fixed point of the renormalization group in the fourth order of the $\varepsilon$-expansion has been determined, and the index $\omega$, which defines the infrared stability of this point, has been calculated. We demonstrate the possibility of significantly reducing the number of Feynman diagrams through mutual cancellation. The results obtained allow us to find the four terms of the $\varepsilon$-expansion of the index $\omega$: $$ \omega = 2\,\varepsilon + \frac{2}{3}\,\varepsilon^2 + \frac{10}{9}\,\varepsilon^3 + \frac{56}{27}\,\varepsilon^4. $$