title: Branched It\^o formula and natural It\^o-Stratonovich isomorphism

abstract: Branched rough paths, defined as characters over the Connes-Kreimer Hopf algebra $\mathcal{H}_\mathrm{CK}$, constitute integration theories that may fail to satisfy the usual integration by parts identity. Using known results on the primitive elements of $\mathcal{H}_\mathrm{CK}$ we can view it as a commutative cofree Hopf algebra (i.e. a commutative $\mathbf{B}_\infty$-algebra) and thus write an explicit change-of-variable formula for solutions to rough differential equations. This formula, which is realised through an explicit morphism from the Grossman-Larson Hopf algebra to the Hopf algebra of differential operators, restricts to the well-known It\^o formula in the very special case of semimartingales. In addition, we establish an isomorphism between $\mathcal{H}_\mathrm{CK}$ and the shuffle algebra over its primitives, which extends Hoffman's exponential for the quasi-shuffle algebra, and can therefore be viewed as a far-reaching generalisation of the usual It\^o-Stratonovich correction formula for semimartingales. Indeed, this can be stated as a characterisation of the algebra structure of any commutative $\mathbf{B}_\infty$-algebra. Compared to previous approaches, this transformation has the key property of being natural in the decorating vector space. We study the one-dimensional case more closely, by introducing the branched analogue of the Kailath-Segall polynomials and Dol\'eans-Dade exponential, and conclude with some examples of branched rough path lifts of a stochastic process which are not quasi-geometric.


title: RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models

abstract: Recent advancements in diffusion-based models have demonstrated significant success in generating images from text. However, video editing models have not yet reached the same level of visual quality and user control. To address this, we introduce RAVE, a zero-shot video editing method that leverages pre-trained text-to-image diffusion models without additional training. RAVE takes an input video and a text prompt to produce high-quality videos while preserving the original motion and semantic structure. It employs a novel noise shuffling strategy, leveraging spatio-temporal interactions between frames, to produce temporally consistent videos faster than existing methods. It is also efficient in terms of memory requirements, allowing it to handle longer videos. RAVE is capable of a wide range of edits, from local attribute modifications to shape transformations. In order to demonstrate the versatility of RAVE, we create a comprehensive video evaluation dataset ranging from object-focused scenes to complex human activities like dancing and typing, and dynamic scenes featuring swimming fish and boats. Our qualitative and quantitative experiments highlight the effectiveness of RAVE in diverse video editing scenarios compared to existing methods. Our code, dataset and videos can be found in https://rave-video.github.io.


title: Supersymmetric generalization of q-deformed long-range spin chains of Haldane-Shastry type and trigonometric GL(N|M) solution of associative Yang-Baxter equation

abstract: We propose commuting sets of matrix-valued difference operators in terms of trigonometric ${\rm GL}(N|M)$-valued $R$-matrices thus providing quantum supersymmetric (and possibly anisotropic) spin Ruijsenaars-Macdonald operators. Two types of trigonometric supersymmetric $R$-matrices are used for this purpose. The first is the one related to the affine quantized algebra ${\hat{\mathcal U}}_q({\rm gl}(N|M))$. The second is a graded version of the standard $\mathbb Z_n$-invariant $A_{n-1}$ type $R$-matrix. We show that being properly normalized the latter graded $R$-matrix satisfies the associative Yang-Baxter equation. Next, we discuss construction of long-range spin chains using the Polychronakos freezing trick. As a result we obtain a new family of spin chains, which extends the ${\rm gl}(N|M)$-invariant Haldane-Shastry spin chain to q-deformed case with possible presence of anisotropy.

categories: math-ph cond-mat.str-el hep-th math.MP math.QA nlin.SI


title: Algorithms for the Global Domination Problem

abstract: A dominating set D in a graph G is a subset of its vertices such that every vertex of the graph which does not belong to set D is adjacent to at least one vertex from set D. A set of vertices of graph G is a global dominating set if it is a dominating set for both, graph G and its complement. The objective is to find a global dominating set with the minimum cardinality. The problem is known to be NP-hard. Neither exact nor approximation algorithm existed . We propose two exact solution methods, one of them being based on an integer linear program (ILP) formulation, three heuristic algorithms and a special purification procedure that further reduces the size of a global dominated set delivered by any of our heuristic algorithms. We show that the problem remains NP-hard for restricted types of graphs and specify some families of graphs for which the heuristics guarantee the optimality. The second exact algorithm turned out to be about twice faster than ILP for graphs with more than 230 vertices and up to 1080 vertices, which were the largest benchmark instances that were solved optimally. The heuristics were tested for the existing 2284 benchmark problem instances with up to 14000 vertices and delivered solutions for the largest instances in less than one minute. Remarkably, for about 52% of the 1000 instances with the obtained optimal solutions, at least one of the heuristics generated an optimal solution, where the average approximation error for the remaining instances was 1.07%.


title: Correspondences of the Third Kind: Camera Pose Estimation from Object Reflection

abstract: Computer vision has long relied on two kinds of correspondences: pixel correspondences in images and 3D correspondences on object surfaces. Is there another kind, and if there is, what can they do for us? In this paper, we introduce correspondences of the third kind we call reflection correspondences and show that they can help estimate camera pose by just looking at objects without relying on the background. Reflection correspondences are point correspondences in the reflected world, i.e., the scene reflected by the object surface. The object geometry and reflectance alters the scene geometrically and radiometrically, respectively, causing incorrect pixel correspondences. Geometry recovered from each image is also hampered by distortions, namely generalized bas-relief ambiguity, leading to erroneous 3D correspondences. We show that reflection correspondences can resolve the ambiguities arising from these distortions. We introduce a neural correspondence estimator and a RANSAC algorithm that fully leverages all three kinds of correspondences for robust and accurate joint camera pose and object shape estimation just from the object appearance. The method expands the horizon of numerous downstream tasks, including camera pose estimation for appearance modeling (e.g., NeRF) and motion estimation of reflective objects (e.g., cars on the road), to name a few, as it relieves the requirement of overlapping background.


title: Using Large Language Models for Hyperparameter Optimization

abstract: This paper studies using foundational large language models (LLMs) to make decisions during hyperparameter optimization (HPO). Empirical evaluations demonstrate that in settings with constrained search budgets, LLMs can perform comparably or better than traditional HPO methods like random search and Bayesian optimization on standard benchmarks. Furthermore, we propose to treat the code specifying our model as a hyperparameter, which the LLM outputs, going beyond the capabilities of existing HPO approaches. Our findings suggest that LLMs are a promising tool for improving efficiency in the traditional decision-making problem of hyperparameter optimization.


title: Diffusion Reflectance Map: Single-Image Stochastic Inverse Rendering of Illumination and Reflectance

abstract: Reflectance bounds the frequency spectrum of illumination in the object appearance. In this paper, we introduce the first stochastic inverse rendering method, which recovers the attenuated frequency spectrum of an illumination jointly with the reflectance of an object of known geometry from a single image. Our key idea is to solve this blind inverse problem in the reflectance map, an appearance representation invariant to the underlying geometry, by learning to reverse the image formation with a novel diffusion model which we refer to as the Diffusion Reflectance Map Network (DRMNet). Given an observed reflectance map converted and completed from the single input image, DRMNet generates a reflectance map corresponding to a perfect mirror sphere while jointly estimating the reflectance. The forward process can be understood as gradually filtering a natural illumination with lower and lower frequency reflectance and additive Gaussian noise. DRMNet learns to invert this process with two subnetworks, IllNet and RefNet, which work in concert towards this joint estimation. The network is trained on an extensive synthetic dataset and is demonstrated to generalize to real images, showing state-of-the-art accuracy on established datasets.


title: Camera Height Doesn't Change: Unsupervised Training for Metric Monocular Road-Scene Depth Estimation

abstract: In this paper, we introduce a novel training method for making any monocular depth network learn absolute scale and estimate metric road-scene depth just from regular training data, i.e., driving videos. We refer to this training framework as StableCamH. The key idea is to leverage cars found on the road as sources of scale supervision but to incorporate them in the training robustly. StableCamH detects and estimates the sizes of cars in the frame and aggregates scale information extracted from them into a camera height estimate whose consistency across the entire video sequence is enforced as scale supervision. This realizes robust unsupervised training of any, otherwise scale-oblivious, monocular depth network to become not only scale-aware but also metric-accurate without the need for auxiliary sensors and extra supervision. Extensive experiments on the KITTI and Cityscapes datasets show the effectiveness of StableCamH and its state-of-the-art accuracy compared with related methods. We also show that StableCamH enables training on mixed datasets of different camera heights, which leads to larger-scale training and thus higher generalization. Metric depth reconstruction is essential in any road-scene visual modeling, and StableCamH democratizes its deployment by establishing the means to train any model as a metric depth estimator.


title: Electrostatic-driven Self-assembly of Janus-like Monolayer-protected Metal Nanoclusters

abstract: The generation of controlled microstructures of functionalized nanoparticles has been one of the crucial challenges in nanoscience and nanotechnology. Efforts have been made to tune ligand charge states that can affect the aggregation propensity and modulate the self-assembled structures. In this work, we modelled zwitterionic Janus-like monolayer ligand-protected metal nanoclusters (J-MPCs) and studied their self-assembly using atomistic molecular dynamics and advanced enhanced sampling simulations. The oppositely-charged ligands functionalization on two hemispheres of a J-MPC elicits asymmetric solvation, primarily driven by distinctive hydrogen bonding patterns in the ligand-solvent interactions. Electrostatic interactions between the oppositely charged residues in J-MPCs guide the formation of one-dimensional and ring-like self-assembled superstructures with molecular dipoles oriented in specific patterns. The pertinent atomistic insights into the intermolecular interactions governing the self-assembled structures of zwitterionic J-MPCs obtained from this work can be used to design a general strategy to create tunable microstructures of charged MPCs.


title: Tournaments on signed graphs

abstract: We classify the set of tournament score sequences on signed graphs, generalizing a classical result of Landau. We also study the combinatorics of such tournaments with given score sequence. Specifically, we show that the Coxeter analogues of the interchange graphs introduced by Brualdi and Li remain degree regular. This degree can be interpreted geometrically, in terms of distances in the Coxeter permutahedra studied recently by Ardila, Castillo, Eur and Postnikov.


title: Dream2Real: Zero-Shot 3D Object Rearrangement with Vision-Language Models

abstract: We introduce Dream2Real, a robotics framework which integrates vision-language models (VLMs) trained on 2D data into a 3D object rearrangement pipeline. This is achieved by the robot autonomously constructing a 3D representation of the scene, where objects can be rearranged virtually and an image of the resulting arrangement rendered. These renders are evaluated by a VLM, so that the arrangement which best satisfies the user instruction is selected and recreated in the real world with pick-and-place. This enables language-conditioned rearrangement to be performed zero-shot, without needing to collect a training dataset of example arrangements. Results on a series of real-world tasks show that this framework is robust to distractors, controllable by language, capable of understanding complex multi-object relations, and readily applicable to both tabletop and 6-DoF rearrangement tasks.


title: PICTURE: PhotorealistIC virtual Try-on from UnconstRained dEsigns

abstract: In this paper, we propose a novel virtual try-on from unconstrained designs (ucVTON) task to enable photorealistic synthesis of personalized composite clothing on input human images. Unlike prior arts constrained by specific input types, our method allows flexible specification of style (text or image) and texture (full garment, cropped sections, or texture patches) conditions. To address the entanglement challenge when using full garment images as conditions, we develop a two-stage pipeline with explicit disentanglement of style and texture. In the first stage, we generate a human parsing map reflecting the desired style conditioned on the input. In the second stage, we composite textures onto the parsing map areas based on the texture input. To represent complex and non-stationary textures that have never been achieved in previous fashion editing works, we first propose extracting hierarchical and balanced CLIP features and applying position encoding in VTON. Experiments demonstrate superior synthesis quality and personalization enabled by our method. The flexible control over style and texture mixing brings virtual try-on to a new level of user experience for online shopping and fashion design.


title: Trajeglish: Traffic Modeling as Next-Token Prediction

abstract: A longstanding challenge for self-driving development is simulating dynamic driving scenarios seeded from recorded driving logs. In pursuit of this functionality, we apply tools from discrete sequence modeling to model how vehicles, pedestrians and cyclists interact in driving scenarios. Using a simple data-driven tokenization scheme, we discretize trajectories to centimeter-level resolution using a small vocabulary. We then model the multi-agent sequence of discrete motion tokens with a GPT-like encoder-decoder that is autoregressive in time and takes into account intra-timestep interaction between agents. Scenarios sampled from our model exhibit state-of-the-art realism; our model tops the Waymo Sim Agents Benchmark, surpassing prior work along the realism meta metric by 3.3% and along the interaction metric by 9.9%. We ablate our modeling choices in full autonomy and partial autonomy settings, and show that the representations learned by our model can quickly be adapted to improve performance on nuScenes. We additionally evaluate the scalability of our model with respect to parameter count and dataset size, and use density estimates from our model to quantify the saliency of context length and intra-timestep interaction for the traffic modeling task.


title: Invisibility of the integers for the discrete Gaussian chain via a Caffarelli-Silvestre extension of the discrete fractional Laplacian

abstract: The Discrete Gaussian Chain is a model of interfaces $\Psi : \mathbf{Z} \to \mathbf{Z}$ governed by the Hamiltonian $$ H(\Psi)= \sum_{i\neq j} J_\alpha(|i-j|) |\Psi_i -\Psi_j|^2 $$ with long-range coupling constants $J_\alpha(k)\asymp k^{-\alpha}$. For any $\alpha\in [2,3)$ and at high enough temperature, we prove an invariance principle for such an $\alpha$-Discrete Gaussian Chain towards a $H(\alpha)$-fractional Gaussian process where the Hurst index $H$ satisfies $H=H(\alpha)=\frac {\alpha-2} 2$. This result goes beyond a conjecture by Fr\"ohlich and Zegarlinski [FZ91] which conjectured fluctuations of order $n^{\tfrac 1 2 (\alpha-2) \wedge 1}$ for the Discrete Gaussian Chain. More surprisingly, as opposed to the case of the $2D$ Discrete Gaussian $\Psi : \mathbf{Z}^2 \to \mathbf{Z}$, we prove that the integers do not affect the {\em effective temperature} of the discrete Gaussian Chain at large scales. Such an {\em invisibility of the integers} had been predicted by Slurink and Hilhorst in the special case $\alpha_c=2$ in [SH83]. We also identify a similar invisibility of integers when a $2D$ Gaussian Free Field at high temperature is conditioned to take integer values on a dilute enough "fractal subset" of $\mathbf{Z}^2$. Our proof relies on four main ingredients: (1) A Caffareli-Silvestre extension for the discrete fractional Laplacian (which may be of independent interest) (2) A localisation of the chain in a smoother sub-domain (3) A Coulomb gas-type expansion in the spirit of Fr\"ohlich-Spencer [FS82] (4) Controlling the amount of Dirichlet Energy supported by a $1D$ band for the Green functions of $\mathbf{Z}^2$ Bessel-type random walks Finally, we also analyse the (easier) regime $\alpha\in(1,2) \cup (3,\infty)$ as well as the $2D$ Discrete Gaussian with long-range coupling constants (for any $\alpha>\alpha_c=4$).


title: Crouzeix's conjecture, compressions of shifts, and classes of nilpotent matrices

abstract: This paper studies the level set Crouzeix conjecture, which is a weak version of Crouzeix's conjecture that applies to finite compressions of the shift. Amongst other results, this paper establishes the level set Crouzeix conjecture for several classes of $3\times3$, $4\times4$, and $5\times5$ matrices associated to compressions of the shift via a geometric analysis of their numerical ranges. This paper also establishes Crouzeix's conjecture for several classes of nilpotent matrices whose studies are motivated by related compressions of shifts.


title: Direct and indirect spin current generation and spin-orbit torques in ferromagnet/nonmagnet/ferromagnet trilayers

abstract: Spin-orbit torques in ferromagnet/nonmagnet/ferromagnet trilayers are studied using a combination of symmetry analysis, circuit theory, semiclassical simulations, and first-principles calculations using the non-equilibrium Green's function method with supercell disorder averaging. We focus on unconventional processes involving the interplay between the two ferromagnetic layers, which are classified into direct and indirect mechanisms. The direct mechanism involves spin current generation by one ferromagnetic layer and its subsequent absorption by the other. In the indirect mechanism, the in-plane spin-polarized current from one ferromagnetic layer ``leaks'' into the other layer, where it is converted into an out-of-plane spin current and reabsorbed by the original layer. The direct mechanism results in a predominantly dampinglike torque, which damps the magnetization towards a certain direction $\mathbf{s}_d$. The indirect mechanism results in a predominantly fieldlike torque with respect to a generally different direction $\mathbf{s}_f$. Similar to the current-in-plane giant magnetoresistance, the indirect mechanism is only active if the thickness of the nonmagnetic spacer is smaller than or comparable to the mean-free path. Numerical calculations for a semiclassical model based on the Boltzmann equation confirm the presence of both direct and indirect mechanisms of spin current generation. First-principles calculations reveal sizeable unconventional spin-orbit torques in Co/Cu/Co, Py/Cu/Py, and Co/Pt/Co trilayers and provide strong evidence of indirect spin current generation.


title: Auto-Vocabulary Semantic Segmentation

abstract: Open-ended image understanding tasks gained significant attention from the research community, particularly with the emergence of Vision-Language Models. Open-Vocabulary Segmentation (OVS) methods are capable of performing semantic segmentation without relying on a fixed vocabulary, and in some cases, they operate without the need for training or fine-tuning. However, OVS methods typically require users to specify the vocabulary based on the task or dataset at hand. In this paper, we introduce \textit{Auto-Vocabulary Semantic Segmentation (AVS)}, advancing open-ended image understanding by eliminating the necessity to predefine object categories for segmentation. Our approach, \ours, presents a framework that autonomously identifies relevant class names using enhanced BLIP embeddings, which are utilized for segmentation afterwards. Given that open-ended object category predictions cannot be directly compared with a fixed ground truth, we develop a Large Language Model-based Auto-Vocabulary Evaluator (LAVE) to efficiently evaluate the automatically generated class names and their corresponding segments. Our method sets new benchmarks on datasets such as PASCAL VOC and Context, ADE20K, and Cityscapes for AVS and showcases competitive performance to OVS methods that require specified class names.


title: Sim-to-Real Causal Transfer: A Metric Learning Approach to Causally-Aware Interaction Representations

abstract: Modeling spatial-temporal interactions among neighboring agents is at the heart of multi-agent problems such as motion forecasting and crowd navigation. Despite notable progress, it remains unclear to which extent modern representations can capture the causal relationships behind agent interactions. In this work, we take an in-depth look at the causal awareness of these representations, from computational formalism to real-world practice. First, we cast doubt on the notion of non-causal robustness studied in the recent CausalAgents benchmark. We show that recent representations are already partially resilient to perturbations of non-causal agents, and yet modeling indirect causal effects involving mediator agents remains challenging. To address this challenge, we introduce a metric learning approach that regularizes latent representations with causal annotations. Our controlled experiments show that this approach not only leads to higher degrees of causal awareness but also yields stronger out-of-distribution robustness. To further operationalize it in practice, we propose a sim-to-real causal transfer method via cross-domain multi-task learning. Experiments on pedestrian datasets show that our method can substantially boost generalization, even in the absence of real-world causal annotations. We hope our work provides a new perspective on the challenges and potential pathways towards causally-aware representations of multi-agent interactions. Our code is available at https://github.com/socialcausality.


title: Electron phonon coupling in ultrathin Pb films on Si(111): Where the heck is the energy?

abstract: In this work, we study the heat transfer from electron to phonon system within a five monolayer thin epitaxial Pb film on Si(111) upon fs-laser excitation. The response of the electron system is determined using time-resolved photoelectron spectroscopy while the lattice excitation is measured by means of the Debye-Waller effect in time-resolved reflection high-energy electron diffraction. The electrons lose their heat within 0.5 ps while the lattice temperature rises slowly in 3.5 to 8 ps, leaving a gap of 3-7 ps. We propose that the hidden energy is transiently stored in high-frequency phonon modes for which diffraction is insensitive and which are excited in 0.5 ps. Within a three-temperature model we use three heat baths, namely electrons, high-frequency and low-frequency phonon modes to simulate the observations. The excitation of low-frequency acoustic phonons, i.e., thermalization of the lattice is facilitated through anharmonic phonon-phonon interaction.


title: SoK: Unintended Interactions among Machine Learning Defenses and Risks

abstract: Machine learning (ML) models cannot neglect risks to security, privacy, and fairness. Several defenses have been proposed to mitigate such risks. When a defense is effective in mitigating one risk, it may correspond to increased or decreased susceptibility to other risks. Existing research lacks an effective framework to recognize and explain these unintended interactions. We present such a framework, based on the conjecture that overfitting and memorization underlie unintended interactions. We survey existing literature on unintended interactions, accommodating them within our framework. We use our framework to conjecture on two previously unexplored interactions, and empirically validate our conjectures.


title: HyperDreamer: Hyper-Realistic 3D Content Generation and Editing from a Single Image

abstract: 3D content creation from a single image is a long-standing yet highly desirable task. Recent advances introduce 2D diffusion priors, yielding reasonable results. However, existing methods are not hyper-realistic enough for post-generation usage, as users cannot view, render and edit the resulting 3D content from a full range. To address these challenges, we introduce HyperDreamer with several key designs and appealing properties: 1) Viewable: 360 degree mesh modeling with high-resolution textures enables the creation of visually compelling 3D models from a full range of observation points. 2) Renderable: Fine-grained semantic segmentation and data-driven priors are incorporated as guidance to learn reasonable albedo, roughness, and specular properties of the materials, enabling semantic-aware arbitrary material estimation. 3) Editable: For a generated model or their own data, users can interactively select any region via a few clicks and efficiently edit the texture with text-based guidance. Extensive experiments demonstrate the effectiveness of HyperDreamer in modeling region-aware materials with high-resolution textures and enabling user-friendly editing. We believe that HyperDreamer holds promise for advancing 3D content creation and finding applications in various domains.


title: A generalization of Siegmund's normal forms theorem to systems with $\mu$-dichotomies

abstract: We establish a theorem concerning the normal forms by examining the newly presented concept of $\mu$-dichotomy. This work establishes the nonresonance condition based on the associated spectrum of this general nonautonomous hyperbolicity.


title: Bar Properties as a Function of Wavelength: A Local Baseline with S4G for High-Redshift Studies

abstract: The redshift evolution of bars is an important signpost of the dynamic maturity of disk galaxies. To characterize the intrinsic evolution safe from band-shifting effects, it is necessary to gauge how bar properties vary locally as a function of wavelength. We investigate bar properties in 16 nearby galaxies from the Spitzer Survey of Stellar Structure in Galaxies (S4G) at ultraviolet, optical and mid-infrared wavebands. Based on the ellipticity and position angle profiles from fitting elliptical isophotes to the two-dimensional light distribution, we find that both bar length and ellipticity - the latter often used as a proxy for bar strength - increase at bluer wavebands. Bars are 9% longer in the B-band than at 3.6 um. Their ellipticity increases typically by 8% in the B-band, with a significant fraction (>40%) displaying an increase up to 35%. We attribute the increase in bar length to the presence of star forming knots at the end of bars: these regions are brighter in bluer bands, stretching the bar signature further out. The increase in bar ellipticity could be driven by the apparent bulge size: the bulge is less prominent at bluer bands, allowing for thinner ellipses within the bar region. Alternatively, it could be due to younger stellar populations associated to the bar. The resulting effect is that bars appear longer and thinner at bluer wavebands. This indicates that band-shifting effects are significant and need to be corrected for high-redshift studies to reliably gauge any intrinsic evolution of the bar properties with redshift.


title: Adversarial Learning for Feature Shift Detection and Correction

abstract: Data shift is a phenomenon present in many real-world applications, and while there are multiple methods attempting to detect shifts, the task of localizing and correcting the features originating such shifts has not been studied in depth. Feature shifts can occur in many datasets, including in multi-sensor data, where some sensors are malfunctioning, or in tabular and structured data, including biomedical, financial, and survey data, where faulty standardization and data processing pipelines can lead to erroneous features. In this work, we explore using the principles of adversarial learning, where the information from several discriminators trained to distinguish between two distributions is used to both detect the corrupted features and fix them in order to remove the distribution shift between datasets. We show that mainstream supervised classifiers, such as random forest or gradient boosting trees, combined with simple iterative heuristics, can localize and correct feature shifts, outperforming current statistical and neural network-based techniques. The code is available at https://github.com/AI-sandbox/DataFix.


title: Digital Life Project: Autonomous 3D Characters with Social Intelligence

abstract: In this work, we present Digital Life Project, a framework utilizing language as the universal medium to build autonomous 3D characters, who are capable of engaging in social interactions and expressing with articulated body motions, thereby simulating life in a digital environment. Our framework comprises two primary components: 1) SocioMind: a meticulously crafted digital brain that models personalities with systematic few-shot exemplars, incorporates a reflection process based on psychology principles, and emulates autonomy by initiating dialogue topics; 2) MoMat-MoGen: a text-driven motion synthesis paradigm for controlling the character's digital body. It integrates motion matching, a proven industry technique to ensure motion quality, with cutting-edge advancements in motion generation for diversity. Extensive experiments demonstrate that each module achieves state-of-the-art performance in its respective domain. Collectively, they enable virtual characters to initiate and sustain dialogues autonomously, while evolving their socio-psychological states. Concurrently, these characters can perform contextually relevant bodily movements. Additionally, a motion captioning module further allows the virtual character to recognize and appropriately respond to human players' actions. Homepage: https://digital-life-project.com/


title: Multiview Aerial Visual Recognition (MAVREC): Can Multi-view Improve Aerial Visual Perception?

abstract: Despite the commercial abundance of UAVs, aerial data acquisition remains challenging, and the existing Asia and North America-centric open-source UAV datasets are small-scale or low-resolution and lack diversity in scene contextuality. Additionally, the color content of the scenes, solar-zenith angle, and population density of different geographies influence the data diversity. These two factors conjointly render suboptimal aerial-visual perception of the deep neural network (DNN) models trained primarily on the ground-view data, including the open-world foundational models. To pave the way for a transformative era of aerial detection, we present Multiview Aerial Visual RECognition or MAVREC, a video dataset where we record synchronized scenes from different perspectives -- ground camera and drone-mounted camera. MAVREC consists of around 2.5 hours of industry-standard 2.7K resolution video sequences, more than 0.5 million frames, and 1.1 million annotated bounding boxes. This makes MAVREC the largest ground and aerial-view dataset, and the fourth largest among all drone-based datasets across all modalities and tasks. Through our extensive benchmarking on MAVREC, we recognize that augmenting object detectors with ground-view images from the corresponding geographical location is a superior pre-training strategy for aerial detection. Building on this strategy, we benchmark MAVREC with a curriculum-based semi-supervised object detection approach that leverages labeled (ground and aerial) and unlabeled (only aerial) images to enhance the aerial detection. We publicly release the MAVREC dataset: https://mavrec.github.io.


title: PlayFusion: Skill Acquisition via Diffusion from Language-Annotated Play

abstract: Learning from unstructured and uncurated data has become the dominant paradigm for generative approaches in language and vision. Such unstructured and unguided behavior data, commonly known as play, is also easier to collect in robotics but much more difficult to learn from due to its inherently multimodal, noisy, and suboptimal nature. In this paper, we study this problem of learning goal-directed skill policies from unstructured play data which is labeled with language in hindsight. Specifically, we leverage advances in diffusion models to learn a multi-task diffusion model to extract robotic skills from play data. Using a conditional denoising diffusion process in the space of states and actions, we can gracefully handle the complexity and multimodality of play data and generate diverse and interesting robot behaviors. To make diffusion models more useful for skill learning, we encourage robotic agents to acquire a vocabulary of skills by introducing discrete bottlenecks into the conditional behavior generation process. In our experiments, we demonstrate the effectiveness of our approach across a wide variety of environments in both simulation and the real world. Results visualizations and videos at https://play-fusion.github.io


title: Iterated invariance principle for random dynamical systems

abstract: We prove a weak iterated invariance principle for a large class of non-uniformly expanding random dynamical systems. In addition, we give a quenched homogenization result for fast-slow systems in the case when the fast component corresponds to a uniformly expanding random system. Our techniques rely on the appropriate martingale decomposition.


title: Free3D: Consistent Novel View Synthesis without 3D Representation

abstract: We introduce Free3D, a simple accurate method for monocular open-set novel view synthesis (NVS). Similar to Zero-1-to-3, we start from a pre-trained 2D image generator for generalization, and fine-tune it for NVS. Compared to other works that took a similar approach, we obtain significant improvements without resorting to an explicit 3D representation, which is slow and memory-consuming, and without training an additional network for 3D reconstruction. Our key contribution is to improve the way the target camera pose is encoded in the network, which we do by introducing a new ray conditioning normalization (RCN) layer. The latter injects pose information in the underlying 2D image generator by telling each pixel its viewing direction. We further improve multi-view consistency by using light-weight multi-view attention layers and by sharing generation noise between the different views. We train Free3D on the Objaverse dataset and demonstrate excellent generalization to new categories in new datasets, including OmniObject3D and GSO. The project page is available at https://chuanxiaz.com/free3d/.


title: Generating Illustrated Instructions

abstract: We introduce the new task of generating Illustrated Instructions, i.e., visual instructions customized to a user's needs. We identify desiderata unique to this task, and formalize it through a suite of automatic and human evaluation metrics, designed to measure the validity, consistency, and efficacy of the generations. We combine the power of large language models (LLMs) together with strong text-to-image generation diffusion models to propose a simple approach called StackedDiffusion, which generates such illustrated instructions given text as input. The resulting model strongly outperforms baseline approaches and state-of-the-art multimodal LLMs; and in 30% of cases, users even prefer it to human-generated articles. Most notably, it enables various new and exciting applications far beyond what static articles on the web can provide, such as personalized instructions complete with intermediate steps and pictures in response to a user's individual situation.


title: SPIDeRS: Structured Polarization for Invisible Depth and Reflectance Sensing

abstract: Can we capture shape and reflectance in stealth? Such capability would be valuable for many application domains in vision, xR, robotics, and HCI. We introduce structured polarization for invisible depth and reflectance sensing (SPIDeRS), the first depth and reflectance sensing method using patterns of polarized light. The key idea is to modulate the angle of linear polarization (AoLP) of projected light at each pixel. The use of polarization makes it invisible and lets us recover not only depth but also directly surface normals and even reflectance. We implement SPIDeRS with a liquid crystal spatial light modulator (SLM) and a polarimetric camera. We derive a novel method for robustly extracting the projected structured polarization pattern from the polarimetric object appearance. We evaluate the effectiveness of SPIDeRS by applying it to a number of real-world objects. The results show that our method successfully reconstructs object shapes of various materials and is robust to diffuse reflection and ambient light. We also demonstrate relighting using recovered surface normals and reflectance. We believe SPIDeRS opens a new avenue of polarization use in visual sensing.


title: Improved Visual Grounding through Self-Consistent Explanations

abstract: Vision-and-language models trained to match images with text can be combined with visual explanation methods to point to the locations of specific objects in an image. Our work shows that the localization --"grounding"-- abilities of these models can be further improved by finetuning for self-consistent visual explanations. We propose a strategy for augmenting existing text-image datasets with paraphrases using a large language model, and SelfEQ, a weakly-supervised strategy on visual explanation maps for paraphrases that encourages self-consistency. Specifically, for an input textual phrase, we attempt to generate a paraphrase and finetune the model so that the phrase and paraphrase map to the same region in the image. We posit that this both expands the vocabulary that the model is able to handle, and improves the quality of the object locations highlighted by gradient-based visual explanation methods (e.g. GradCAM). We demonstrate that SelfEQ improves performance on Flickr30k, ReferIt, and RefCOCO+ over a strong baseline method and several prior works. Particularly, comparing to other methods that do not use any type of box annotations, we obtain 84.07% on Flickr30k (an absolute improvement of 4.69%), 67.40% on ReferIt (an absolute improvement of 7.68%), and 75.10%, 55.49% on RefCOCO+ test sets A and B respectively (an absolute improvement of 3.74% on average).


title: Gauge symmetry of excited states in projected entangled-pair state simulations

abstract: While gauge symmetry is a well-established requirement for representing topological orders in projected entangled-pair state (PEPS), its impact on the properties of low-lying excited states remains relatively unexplored. Here we perform PEPS simulations of low-energy dynamics in the Kitaev honeycomb model, which supports fractionalized gauge flux (vison) excitations. We identify gauge symmetry emerging upon optimizing an unbiased PEPS ground state. Using the PEPS adapted local mode approximation, we further classify the low-lying excited states by discerning different vison sectors. Our simulations of spin and spin-dimer dynamical correlations establish close connections with experimental observations. Notably, the selection rule imposed by the locally conserved visons results in nearly flat dispersions in momentum space for excited states belonging to the 2-vison or 4-vison sectors.


title: Large Language Models for Mathematicians

abstract: Large language models (LLMs) such as ChatGPT have received immense interest for their general-purpose language understanding and, in particular, their ability to generate high-quality text or computer code. For many professions, LLMs represent an invaluable tool that can speed up and improve the quality of work. In this note, we discuss to what extent they can aid professional mathematicians. We first provide a mathematical description of the transformer model used in all modern language models. Based on recent studies, we then outline best practices and potential issues and report on the mathematical abilities of language models. Finally, we shed light on the potential of LLMs to change how mathematicians work.


title: GenTron: Diffusion Transformers for Image and Video Generation

abstract: In this study, we explore Transformer-based diffusion models for image and video generation. Despite the dominance of Transformer architectures in various fields due to their flexibility and scalability, the visual generative domain primarily utilizes CNN-based U-Net architectures, particularly in diffusion-based models. We introduce GenTron, a family of Generative models employing Transformer-based diffusion, to address this gap. Our initial step was to adapt Diffusion Transformers (DiTs) from class to text conditioning, a process involving thorough empirical exploration of the conditioning mechanism. We then scale GenTron from approximately 900M to over 3B parameters, observing significant improvements in visual quality. Furthermore, we extend GenTron to text-to-video generation, incorporating novel motion-free guidance to enhance video quality. In human evaluations against SDXL, GenTron achieves a 51.1% win rate in visual quality (with a 19.8% draw rate), and a 42.3% win rate in text alignment (with a 42.9% draw rate). GenTron also excels in the T2I-CompBench, underscoring its strengths in compositional generation. We believe this work will provide meaningful insights and serve as a valuable reference for future research.


title: MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatar

abstract: The ability to animate photo-realistic head avatars reconstructed from monocular portrait video sequences represents a crucial step in bridging the gap between the virtual and real worlds. Recent advancements in head avatar techniques, including explicit 3D morphable meshes (3DMM), point clouds, and neural implicit representation have been exploited for this ongoing research. However, 3DMM-based methods are constrained by their fixed topologies, point-based approaches suffer from a heavy training burden due to the extensive quantity of points involved, and the last ones suffer from limitations in deformation flexibility and rendering efficiency. In response to these challenges, we propose MonoGaussianAvatar (Monocular Gaussian Point-based Head Avatar), a novel approach that harnesses 3D Gaussian point representation coupled with a Gaussian deformation field to learn explicit head avatars from monocular portrait videos. We define our head avatars with Gaussian points characterized by adaptable shapes, enabling flexible topology. These points exhibit movement with a Gaussian deformation field in alignment with the target pose and expression of a person, facilitating efficient deformation. Additionally, the Gaussian points have controllable shape, size, color, and opacity combined with Gaussian splatting, allowing for efficient training and rendering. Experiments demonstrate the superior performance of our method, which achieves state-of-the-art results among previous methods.


title: PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation

abstract: We present PrimDiffusion, the first diffusion-based framework for 3D human generation. Devising diffusion models for 3D human generation is difficult due to the intensive computational cost of 3D representations and the articulated topology of 3D humans. To tackle these challenges, our key insight is operating the denoising diffusion process directly on a set of volumetric primitives, which models the human body as a number of small volumes with radiance and kinematic information. This volumetric primitives representation marries the capacity of volumetric representations with the efficiency of primitive-based rendering. Our PrimDiffusion framework has three appealing properties: 1) compact and expressive parameter space for the diffusion model, 2) flexible 3D representation that incorporates human prior, and 3) decoder-free rendering for efficient novel-view and novel-pose synthesis. Extensive experiments validate that PrimDiffusion outperforms state-of-the-art methods in 3D human generation. Notably, compared to GAN-based methods, our PrimDiffusion supports real-time rendering of high-quality 3D humans at a resolution of $512\times512$ once the denoising process is done. We also demonstrate the flexibility of our framework on training-free conditional generation such as texture transfer and 3D inpainting.


title: NeRFiller: Completing Scenes via Generative 3D Inpainting

abstract: We propose NeRFiller, an approach that completes missing portions of a 3D capture via generative 3D inpainting using off-the-shelf 2D visual generative models. Often parts of a captured 3D scene or object are missing due to mesh reconstruction failures or a lack of observations (e.g., contact regions, such as the bottom of objects, or hard-to-reach areas). We approach this challenging 3D inpainting problem by leveraging a 2D inpainting diffusion model. We identify a surprising behavior of these models, where they generate more 3D consistent inpaints when images form a 2$\times$2 grid, and show how to generalize this behavior to more than four images. We then present an iterative framework to distill these inpainted regions into a single consistent 3D scene. In contrast to related works, we focus on completing scenes rather than deleting foreground objects, and our approach does not require tight 2D object masks or text. We compare our approach to relevant baselines adapted to our setting on a variety of scenes, where NeRFiller creates the most 3D consistent and plausible scene completions. Our project page is at https://ethanweber.me/nerfiller.


title: GenDeF: Learning Generative Deformation Field for Video Generation

abstract: We offer a new perspective on approaching the task of video generation. Instead of directly synthesizing a sequence of frames, we propose to render a video by warping one static image with a generative deformation field (GenDeF). Such a pipeline enjoys three appealing advantages. First, we can sufficiently reuse a well-trained image generator to synthesize the static image (also called canonical image), alleviating the difficulty in producing a video and thereby resulting in better visual quality. Second, we can easily convert a deformation field to optical flows, making it possible to apply explicit structural regularizations for motion modeling, leading to temporally consistent results. Third, the disentanglement between content and motion allows users to process a synthesized video through processing its corresponding static image without any tuning, facilitating many applications like video editing, keypoint tracking, and video segmentation. Both qualitative and quantitative results on three common video generation benchmarks demonstrate the superiority of our GenDeF method.


title: Glassy word problems: ultraslow relaxation, Hilbert space jamming, and computational complexity

abstract: We introduce a family of local models of dynamics based on ``word problems'' from computer science and group theory, for which we can place rigorous lower bounds on relaxation timescales. These models can be regarded either as random circuit or local Hamiltonian dynamics, and include many familiar examples of constrained dynamics as special cases. The configuration space of these models splits into dynamically disconnected sectors, and for initial states to relax, they must ``work out'' the other states in the sector to which they belong. When this problem has a high time complexity, relaxation is slow. In some of the cases we study, this problem also has high space complexity. When the space complexity is larger than the system size, an unconventional type of jamming transition can occur, whereby a system of a fixed size is not ergodic, but can be made ergodic by appending a large reservoir of sites in a trivial product state. This manifests itself in a new type of Hilbert space fragmentation that we call fragile fragmentation. We present explicit examples where slow relaxation and jamming strongly modify the hydrodynamics of conserved densities. In one example, density modulations of wavevector $q$ exhibit almost no relaxation until times $O(\exp(1/q))$, at which point they abruptly collapse. We also comment on extensions of our results to higher dimensions.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech math-ph math.MP


title: Visual Geometry Grounded Deep Structure From Motion

abstract: Structure-from-motion (SfM) is a long-standing problem in the computer vision community, which aims to reconstruct the camera poses and 3D structure of a scene from a set of unconstrained 2D images. Classical frameworks solve this problem in an incremental manner by detecting and matching keypoints, registering images, triangulating 3D points, and conducting bundle adjustment. Recent research efforts have predominantly revolved around harnessing the power of deep learning techniques to enhance specific elements (e.g., keypoint matching), but are still based on the original, non-differentiable pipeline. Instead, we propose a new deep pipeline VGGSfM, where each component is fully differentiable and thus can be trained in an end-to-end manner. To this end, we introduce new mechanisms and simplifications. First, we build on recent advances in deep 2D point tracking to extract reliable pixel-accurate tracks, which eliminates the need for chaining pairwise matches. Furthermore, we recover all cameras simultaneously based on the image and track features instead of gradually registering cameras. Finally, we optimise the cameras and triangulate 3D points via a differentiable bundle adjustment layer. We attain state-of-the-art performance on three popular datasets, CO3D, IMC Phototourism, and ETH3D.


title: EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingS

abstract: Recently, 3D Gaussian splatting (3D-GS) has gained popularity in novel-view scene synthesis. It addresses the challenges of lengthy training times and slow rendering speeds associated with Neural Radiance Fields (NeRFs). Through rapid, differentiable rasterization of 3D Gaussians, 3D-GS achieves real-time rendering and accelerated training. They, however, demand substantial memory resources for both training and storage, as they require millions of Gaussians in their point cloud representation for each scene. We present a technique utilizing quantized embeddings to significantly reduce per-point memory storage requirements and a coarse-to-fine training strategy for a faster and more stable optimization of the Gaussian point clouds. Our approach develops a pruning stage which results in scene representations with fewer Gaussians, leading to faster training times and rendering speeds for real-time rendering of high resolution scenes. We reduce storage memory by more than an order of magnitude all while preserving the reconstruction quality. We validate the effectiveness of our approach on a variety of datasets and scenes preserving the visual quality while consuming 10-20x lesser memory and faster training/inference speed. Project page and code is available https://efficientgaussian.github.io


title: MuRF: Multi-Baseline Radiance Fields

abstract: We present Multi-Baseline Radiance Fields (MuRF), a general feed-forward approach to solving sparse view synthesis under multiple different baseline settings (small and large baselines, and different number of input views). To render a target novel view, we discretize the 3D space into planes parallel to the target image plane, and accordingly construct a target view frustum volume. Such a target volume representation is spatially aligned with the target view, which effectively aggregates relevant information from the input views for high-quality rendering. It also facilitates subsequent radiance field regression with a convolutional network thanks to its axis-aligned nature. The 3D context modeled by the convolutional network enables our method to synthesis sharper scene structures than prior works. Our MuRF achieves state-of-the-art performance across multiple different baseline settings and diverse scenarios ranging from simple objects (DTU) to complex indoor and outdoor scenes (RealEstate10K and LLFF). We also show promising zero-shot generalization abilities on the Mip-NeRF 360 dataset, demonstrating the general applicability of MuRF.


title: Gen2Det: Generate to Detect

abstract: Recently diffusion models have shown improvement in synthetic image quality as well as better control in generation. We motivate and present Gen2Det, a simple modular pipeline to create synthetic training data for object detection for free by leveraging state-of-the-art grounded image generation methods. Unlike existing works which generate individual object instances, require identifying foreground followed by pasting on other images, we simplify to directly generating scene-centric images. In addition to the synthetic data, Gen2Det also proposes a suite of techniques to best utilize the generated data, including image-level filtering, instance-level filtering, and better training recipe to account for imperfections in the generation. Using Gen2Det, we show healthy improvements on object detection and segmentation tasks under various settings and agnostic to detection methods. In the long-tailed detection setting on LVIS, Gen2Det improves the performance on rare categories by a large margin while also significantly improving the performance on other categories, e.g. we see an improvement of 2.13 Box AP and 1.84 Mask AP over just training on real data on LVIS with Mask R-CNN. In the low-data regime setting on COCO, Gen2Det consistently improves both Box and Mask AP by 2.27 and 1.85 points. In the most general detection setting, Gen2Det still demonstrates robust performance gains, e.g. it improves the Box and Mask AP on COCO by 0.45 and 0.32 points.


title: Scaling Laws of Synthetic Images for Model Training ... for Now

abstract: Recent significant advances in text-to-image models unlock the possibility of training vision systems using synthetic images, potentially overcoming the difficulty of collecting curated data at scale. It is unclear, however, how these models behave at scale, as more synthetic data is added to the training set. In this paper we study the scaling laws of synthetic images generated by state of the art text-to-image models, for the training of supervised models: image classifiers with label supervision, and CLIP with language supervision. We identify several factors, including text prompts, classifier-free guidance scale, and types of text-to-image models, that significantly affect scaling behavior. After tuning these factors, we observe that synthetic images demonstrate a scaling trend similar to, but slightly less effective than, real images in CLIP training, while they significantly underperform in scaling when training supervised image classifiers. Our analysis indicates that the main reason for this underperformance is the inability of off-the-shelf text-to-image models to generate certain concepts, a limitation that significantly impairs the training of image classifiers. Our findings also suggest that scaling synthetic data can be particularly effective in scenarios such as: (1) when there is a limited supply of real images for a supervised problem (e.g., fewer than 0.5 million images in ImageNet), (2) when the evaluation dataset diverges significantly from the training data, indicating the out-of-distribution scenario, or (3) when synthetic data is used in conjunction with real images, as demonstrated in the training of CLIP models.


title: Multimodality of $^{187}$Ir fission studied by Langevin approach

abstract: [Background] The fission mechanism of sub-lead nuclides remains unclear, especially the types of fission modes involved and their corresponding shell effects. [Purpose] The aim is to identify the different modes in the fission of $^{187}$Ir, and investigate the corresponding mechanism. [Method] The three-dimensional Langevin approach considering nucleus elongation, deformation, and mass asymmetry is applied to simulate fission dynamics. The macro-microscopic models are used to calculate the transport coefficients. [Results] The fragment mass, deformation, and total kinetic energy (TKE) of $^{187}$Ir fission at different excitation energies are calculated. Based on the mass-TKE correlations, four fission modes are identified, namely two asymmetric standard modes, a symmetric super-long mode, and a symmetric liquid-drop mode. Strong excitation-energy resistance of two asymmetric modes is found. The mass distributions show the dominance of single-peak shape, which is in good agreement with experimental data. The fission potential energy surface and the fission dynamics are analyzed to investigate the origins of the modes and the competition between neutron and proton shell effects. [Conclusions] Multiple fission modes are included in the $^{187}$Ir fission behind the single-peak-like distribution of observables. The proton and neutron magic numbers with different asymmetry parameter might heighten the sensitivity to the uncertainties of shell corrections.


title: How do referees integrate evaluation criteria into their overall judgment? Evidence from grant peer review

abstract: Little is known whether peer reviewers use the same evaluation criteria and how they integrate the criteria into their overall judgment. This study therefore proposed two assessment styles based on theoretical perspectives and normative positions. According to the case-by-case style, referees use many and different criteria, weight criteria on a case-by-case basis, and integrate criteria in a complex, non-mechanical way into their overall judgment. According to the uniform style, referees use a small fraction of the available criteria, apply the same criteria, weight the criteria in the same way, and integrate the criteria based on simple rules (i.e., fast-and-frugal heuristics). These two styles were examined using a unique dataset from a career funding scheme that contained a comparatively large number of evaluation criteria. A heuristic (fast-and-frugal trees) and a complex procedure (logistic regression) were employed to describe how referees integrate the criteria into their overall judgment. The logistic regression predicted the referees' overall assessment with high accuracy and slightly more accurately than the fast-and-frugal trees. Overall, the results of this study support the uniform style but also indicate that the uniform style needs to be revised as follows: referees use many criteria and integrate the criteria using complex rules. However, and most importantly, the revised style could describe most - but not all - of the referees' judgments. Future studies should therefore examine how referees' judgments can be characterized in those cases where the uniform style failed. Moreover, the evaluation process of referees should be studied in more empirical and theoretical detail.


title: Deep Reinforcement Learning for 2D Physics-Based Object Manipulation in Clutter

abstract: Deep Reinforcement Learning (DRL) is a quickly evolving research field rooted in operations research and behavioural psychology, with potential applications extending across various domains, including robotics. This thesis delineates the background of modern Reinforcement Learning (RL), starting with the framework constituted by the Markov decision processes, Markov properties, goals and rewards, agent-environment interactions, and policies. We explain the main types of algorithms commonly used in RL, including value-based, policy gradient, and actor-critic methods, with a special emphasis on DQN, A2C and PPO. We then give a short literature review on some widely adopted frameworks for implementing RL algorithms and environments. Subsequently, we present Bidimensional Gripper Environment (BGE), a virtual simulator based on the Pymunk physics engine we developed to analyse top-down bidimensional object manipulation. The methodology section frames our agent-environment interaction as a Markov decision process, such that we can apply our RL algorithms. We list various goal formulation strategies, including reward shaping and curriculum learning. We also employ different steps of observation preprocessing to reduce the computational workload required. In the experimental phase, we run through a series of scenarios of increasing difficulty. We start with a simple static scenario and then gradually increase the amount of stochasticity. Whenever the agents show difficulty in learning, we counteract by increasing the degree of reward shaping and curriculum learning. These experiments demonstrate the substantial limitations and pitfalls of model-free algorithms under changing dynamics. In conclusion, we present a summary of our findings and remarks. We then outline potential future work to improve our methodology and possibly expand to real-world systems.


title: SwarMer: A Decentralized Localization Framework for Flying Light Specks

abstract: Swarm-Merging, SwarMer, is a decentralized framework to localize Flying Light Specks (FLSs) to render 2D and 3D shapes. An FLS is a miniature sized drone equipped with one or more light sources to generate different colors and textures with adjustable brightness. It is battery powered, network enabled with storage and processing capability to implement a decentralized algorithm such as SwarMer. An FLS is unable to render a shape by itself. SwarMer uses the inter-FLS relationship effect of its organizational framework to compensate for the simplicity of each individual FLS, enabling a swarm of cooperating FLSs to render complex shapes. SwarMer is resilient to both FLSs failing and FLSs leaving to charge their battery. It is fast, highly accurate, and scales to remain effective when a shape consists of a large number of FLSs.


title: Harnessing LSTM for Nonlinear Ship Deck Motion Prediction in UAV Autonomous Landing amidst High Sea States

abstract: Autonomous landing of UAVs in high sea states requires the UAV to land exclusively during the ship deck's "rest period," coinciding with minimal movement. Given this scenario, determining the ship's "rest period" based on its movement patterns becomes a fundamental prerequisite for addressing this challenge. This study employs the Long Short-Term Memory (LSTM) neural network to predict the ship's motion across three dimensions: longi-tudinal, transverse, and vertical waves. In the absence of actual ship data under high sea states, this paper employs a composite sine wave model to simulate ship deck motion. Through this approach, a highly accurate model is established, exhibiting promising outcomes within various stochastic sine wave combination models.


title: Criteria and Tips for Choosing Suitable Journal for Your Paper

abstract: Selecting the right journal for your research paper is a pivotal decision in the academic publishing journey. This paper aims to guide researchers through the process of choosing a suitable journal for their work by discussing key criteria and offering practical tips.


title: Differentiable Visual Computing for Inverse Problems and Machine Learning

abstract: Originally designed for applications in computer graphics, visual computing (VC) methods synthesize information about physical and virtual worlds, using prescribed algorithms optimized for spatial computing. VC is used to analyze geometry, physically simulate solids, fluids, and other media, and render the world via optical techniques. These fine-tuned computations that operate explicitly on a given input solve so-called forward problems, VC excels at. By contrast, deep learning (DL) allows for the construction of general algorithmic models, side stepping the need for a purely first principles-based approach to problem solving. DL is powered by highly parameterized neural network architectures -- universal function approximators -- and gradient-based search algorithms which can efficiently search that large parameter space for optimal models. This approach is predicated by neural network differentiability, the requirement that analytic derivatives of a given problem's task metric can be computed with respect to neural network's parameters. Neural networks excel when an explicit model is not known, and neural network training solves an inverse problem in which a model is computed from data.


title: Phonon topology and winding of spectral weight in graphite

abstract: The topology of electronic and phonon band structures of graphene is well studied and known to exhibit a Dirac cone at the K point of the Brillouin zone. Here, we applied inelastic x-ray scattering (IXS) along with $\textit{ab initio}$ calculations to investigate phonon topology in graphite, the 3D analogue of graphene. We identified a pair of modes that form a very weakly gapped linear anticrossing at the K point that can be essentially viewed as a Dirac cone approximant. The IXS intensity in the vicinity of the quasi-Dirac point reveals a harmonic modulation of the phonon spectral weight above and below the Dirac energy, which was previously proposed as an experimental fingerprint of the nontrivial topology. We illustrate how the topological winding of IXS intensity can be understood in terms of atomic displacements, and highlight that the intensity winding is not in fact sensitive in telling quasi- and true Dirac points apart.


title: The Open Review-Based (ORB) dataset: Towards Automatic Assessment of Scientific Papers and Experiment Proposals in High-Energy Physics

abstract: With the Open Science approach becoming important for research, the evolution towards open scientific-paper reviews is making an impact on the scientific community. However, there is a lack of publicly available resources for conducting research activities related to this subject, as only a limited number of journals and conferences currently allow access to their review process for interested parties. In this paper, we introduce the new comprehensive Open Review-Based dataset (ORB); it includes a curated list of more than 36,000 scientific papers with their more than 89,000 reviews and final decisions. We gather this information from two sources: the OpenReview.net and SciPost.org websites. However, given the volatile nature of this domain, the software infrastructure that we introduce to supplement the ORB dataset is designed to accommodate additional resources in the future. The ORB deliverables include (1) Python code (interfaces and implementations) to translate document data and metadata into a structured and high-level representation, (2) an ETL process (Extract, Transform, Load) to facilitate the automatic updates from defined sources and (3) data files representing the structured data. The paper presents our data architecture and an overview of the collected data along with relevant statistics. For illustration purposes, we also discuss preliminary Natural-Language-Processing-based experiments that aim to predict (1) papers' acceptance based on their textual embeddings, and (2) grading statistics inferred from embeddings as well. We believe ORB provides a valuable resource for researchers interested in open science and review, with our implementation easing the use of this data for further analysis and experimentation. We plan to update ORB as the field matures as well as introduce new resources even more fitted to dedicated scientific domains such as High-Energy Physics.


title: The Evolution of DNS Security and Privacy

abstract: DNS, one of the fundamental protocols of the TCP/IP stack, has evolved over the years to protect against threats and attacks. This study examines the risks associated with DNS and explores recent advancements that contribute towards making the DNS ecosystem resilient against various attacks while safeguarding user privacy.


title: Towards a Psychological Generalist AI: A Survey of Current Applications of Large Language Models and Future Prospects

abstract: The complexity of psychological principles underscore a significant societal challenge, given the vast social implications of psychological problems. Bridging the gap between understanding these principles and their actual clinical and real-world applications demands rigorous exploration and adept implementation. In recent times, the swift advancement of highly adaptive and reusable artificial intelligence (AI) models has emerged as a promising way to unlock unprecedented capabilities in the realm of psychology. This paper emphasizes the importance of performance validation for these large-scale AI models, emphasizing the need to offer a comprehensive assessment of their verification from diverse perspectives. Moreover, we review the cutting-edge advancements and practical implementations of these expansive models in psychology, highlighting pivotal work spanning areas such as social media analytics, clinical nursing insights, vigilant community monitoring, and the nuanced exploration of psychological theories. Based on our review, we project an acceleration in the progress of psychological fields, driven by these large-scale AI models. These future generalist AI models harbor the potential to substantially curtail labor costs and alleviate social stress. However, this forward momentum will not be without its set of challenges, especially when considering the paradigm changes and upgrades required for medical instrumentation and related applications.


title: zkDFL: An efficient and privacy-preserving decentralized federated learning with zero-knowledge proof

abstract: Federated learning (FL) has been widely adopted in various fields of study and business. Traditional centralized FL systems suffer from serious issues. To address these concerns, decentralized federated learning (DFL) systems have been introduced in recent years. With the help of blockchains, they attempt to achieve more integrity and efficiency. However, privacy preservation remains an uncovered aspect of these systems. To tackle this, as well as to scale the blockchain-based computations, we propose a zero-knowledge proof (ZKP)-based aggregator (zkDFL). This allows clients to share their large-scale model parameters with a trusted centralized server without revealing their individual data to other clients. We utilize blockchain technology to manage the aggregation algorithm via smart contracts. The server performs a ZKP algorithm to prove to the clients that the aggregation is done according to the accepted algorithm. Additionally, the server can prove that all inputs from clients have been used. We evaluate our approach using a public dataset related to the wearable Internet of Things. As demonstrated by numerical evaluations, zkDFL introduces verifiability of the correctness of the aggregation process and enhances the privacy protection and scalability of DFL systems, while the gas cost has significantly declined.


title: Reply to "Comment on Absence of off-diagonal long-range order in hcp $^{\bf 4}$He dislocation cores"

abstract: We offer a Reply to Document arXiv:2303.12174 by M. Boninsegni et al., commenting on arXiv:2301.02854 .


title: Derivation of the stochastic Hamilton-Jacobi-Bellman equation

abstract: In the present paper, we provide a detailed derivation of the stochastic Hamilton-Jacobi-Bellman equation


title: Split ring versus M\"obius strip: topology and curvature effects

abstract: The influence of the topology and curvature of objects on photonic properties represents an intriguing fundamental problem from cosmology to nanostructure physics. The classical topological transition from a ring to a M\"obius strip is accompanied by a loss of part of the wavelength, compensated by the Berry phase. In contrast, a strip with the same curvature but without a 180{\deg} rotation has a zero Berry phase. Here we demonstrate experimentally and theoretically that the topological transition from a ring to a flat split ring accumulated both such effects. By cutting a flat dielectric ring of rectangular cross-section, we observe the lifting of the degeneracy of the CW-CCW modes of the ring and the formation of two families: topological modes that acquire an additional phase in the range from 0 to {\pi} depending on the gap width, and ordinary modes that do not acquire an additional phase. An order parameter is introduced that accurately describes the magnitude of the spectral splitting of ordinary and topological modes. We established that an arbitrary non-integer number of waves can fit along the length of a dielectric split ring resonator, creating a new avenue in classical and quantum photonic applications.


title: The energy-momentum tensor of the electromagnetic field with a non-zero trace, the virial theorem and plasma equilibrium

abstract: The zero trace of the known energy-momentum tensors (EMT) of the electromagnetic field (EMF) leads to contradictions in the virial theorem for a system of charged particles and incorrect conclusions on the equilibrium state of the plasma. From the EMF and induction tensors, in the form of their matrix product, a EMT with a non-zero trace is obtained. Its trace is a quadratic invariant of the EMF. The consequences of the new EMT for electromagnetic forces, the virial theorem and the conditions of the equilibrium state of a system of charged particles and long-lived plasma phenomena are shown.


title: Towards Sample-specific Backdoor Attack with Clean Labels via Attribute Trigger

abstract: Currently, sample-specific backdoor attacks (SSBAs) are the most advanced and malicious methods since they can easily circumvent most of the current backdoor defenses. In this paper, we reveal that SSBAs are not sufficiently stealthy due to their poisoned-label nature, where users can discover anomalies if they check the image-label relationship. In particular, we demonstrate that it is ineffective to directly generalize existing SSBAs to their clean-label variants by poisoning samples solely from the target class. We reveal that it is primarily due to two reasons, including \textbf{(1)} the `antagonistic effects' of ground-truth features and \textbf{(2)} the learning difficulty of sample-specific features. Accordingly, trigger-related features of existing SSBAs cannot be effectively learned under the clean-label setting due to their mild trigger intensity required for ensuring stealthiness. We argue that the intensity constraint of existing SSBAs is mostly because their trigger patterns are `content-irrelevant' and therefore act as `noises' for both humans and DNNs. Motivated by this understanding, we propose to exploit content-relevant features, $a.k.a.$ (human-relied) attributes, as the trigger patterns to design clean-label SSBAs. This new attack paradigm is dubbed backdoor attack with attribute trigger (BAAT). Extensive experiments are conducted on benchmark datasets, which verify the effectiveness of our BAAT and its resistance to existing defenses.


title: Second- and third-order properties of multidimensional Langevin equations

abstract: Recent work has addressed the problem of inferring Langevin dynamics from data. In this work, we address the problem of relating terms in the Langevin equation to statistical properties, such as moments of the probability density function and of the probability current density, as well as covariance functions. We first review the case of linear Gaussian dynamics, and then consider extensions beyond this simple case. We address the question of quantitative significance of effects. We also analyze underdamped (second-order) processes, specifically in the limit where dynamics in state space is almost Markovian. Finally, we address detection of non-Markovianity.


title: Automated SELinux RBAC Policy Verification Using SMT

abstract: Security-Enhanced Linux (SELinux) is a Linux kernel module that allows for a role-based access control (RBAC) mechanism. It provides a fine-grained security framework enabling system administrators to define security policies at the system and application level. Whilst SELinux offers robust security features through a customisable, powerful RBAC model, its manual policy management is prone to error, leaving the system vulnerable to accidental misconfigurations or loopholes. We present a tool to automate the conversion of SELinux policies into satisfiability modulo theories (SMT), enabling the verification of the intended security configurations using automated theorem proving. Our tool is capable of flagging common policy misconfigurations by asserting consistency between supplied RBAC policies and the intended specification by the user in SMT. RBAC policies are inherently complicated to verify entirely. We envision that the automated tool presented here can be further extended to identify an even broader range of policy misconfigurations, relieving the burden of managing convoluted policies on system administrators.


title: FedBayes: A Zero-Trust Federated Learning Aggregation to Defend Against Adversarial Attacks

abstract: Federated learning has created a decentralized method to train a machine learning model without needing direct access to client data. The main goal of a federated learning architecture is to protect the privacy of each client while still contributing to the training of the global model. However, the main advantage of privacy in federated learning is also the easiest aspect to exploit. Without being able to see the clients' data, it is difficult to determine the quality of the data. By utilizing data poisoning methods, such as backdoor or label-flipping attacks, or by sending manipulated information about their data back to the server, malicious clients are able to corrupt the global model and degrade performance across all clients within a federation. Our novel aggregation method, FedBayes, mitigates the effect of a malicious client by calculating the probabilities of a client's model weights given to the prior model's weights using Bayesian statistics. Our results show that this approach negates the effects of malicious clients and protects the overall federation.


title: How big a table do you need for your jigsaw puzzle?

abstract: Jigsaw puzzles are typically labeled with their finished area and number of pieces. With this information, is it possible to estimate the area required to lay each piece flat before assembly? We derive a simple formula based on two-dimensional circular packing and show that the unassembled puzzle area is $\sqrt{3}$ times the assembled puzzle area, independent of the number of pieces. We perform measurements on 9 puzzles ranging from 333 cm$^2$ (9 pieces) to 6798 cm$^2$ (2000 pieces) and show that the formula accurately predicts realistic assembly scenarios.


title: Measuring the speed of scalar induced gravitational waves from observations

abstract: We investigate the scalar induced gravitational waves which propagate with a speed different from the speed of light. First, we analytically calculate the expression of the power spectrum of the scalar induced gravitational waves which is based on the speed and the spectrum of the primordial curvature perturbations. Then, we discuss several scalar power spectra and obtain corresponding fractional energy density, such as the monochromatic power spectrum, the scale invariant power spectrum and the power-law power spectrum. Finally, we constrain the scalar induced gravitational waves and evaluate the signatures of the speed from the combination of CMB+BAO and gravitational waves observations. The numerical results are obvious to reveal the influence of speed of scalar induced gravitational waves.


title: Reconciling AI Performance and Data Reconstruction Resilience for Medical Imaging

abstract: Artificial Intelligence (AI) models are vulnerable to information leakage of their training data, which can be highly sensitive, for example in medical imaging. Privacy Enhancing Technologies (PETs), such as Differential Privacy (DP), aim to circumvent these susceptibilities. DP is the strongest possible protection for training models while bounding the risks of inferring the inclusion of training samples or reconstructing the original data. DP achieves this by setting a quantifiable privacy budget. Although a lower budget decreases the risk of information leakage, it typically also reduces the performance of such models. This imposes a trade-off between robust performance and stringent privacy. Additionally, the interpretation of a privacy budget remains abstract and challenging to contextualize. In this study, we contrast the performance of AI models at various privacy budgets against both, theoretical risk bounds and empirical success of reconstruction attacks. We show that using very large privacy budgets can render reconstruction attacks impossible, while drops in performance are negligible. We thus conclude that not using DP -- at all -- is negligent when applying AI models to sensitive data. We deem those results to lie a foundation for further debates on striking a balance between privacy risks and model performance.


title: Toward Energy-Efficient Massive MIMO: Graph Neural Network Precoding for Mitigating Non-Linear PA Distortion

abstract: Massive MIMO systems are typically designed assuming linear power amplifiers (PAs). However, PAs are most energy efficient close to saturation, where non-linear distortion arises. For conventional precoders, this distortion can coherently combine at user locations, limiting performance. We propose a graph neural network (GNN) to learn a mapping between channel and precoding matrices, which maximizes the sum rate affected by non-linear distortion, using a high-order polynomial PA model. In the distortion-limited regime, this GNN-based precoder outperforms zero forcing (ZF), ZF plus digital pre-distortion (DPD) and the distortion-aware beamforming (DAB) precoder from the state-of-the-art. At an input back-off of -3 dB the proposed precoder compared to ZF increases the sum rate by 8.60 and 8.84 bits/channel use for two and four users respectively. Radiation patterns show that these gains are achieved by transmitting the non-linear distortion in non-user directions. In the four user-case, for a fixed sum rate, the total consumed power (PA and processing) of the GNN precoder is 3.24 and 1.44 times lower compared to ZF and ZF plus DPD respectively. A complexity analysis shows six orders of magnitude reduction compared to DAB precoding. This opens perspectives to operate PAs closer to saturation, which drastically increases their energy efficiency.


title: Current induced magnetisation in metal without space-inversion symmetry

abstract: Magneto-electric effect, that is an appearance of magnetisation induced by electric current is allowed by symmetry in metals with crystal structure without space inversion. The microscopic origin of this effect is spin-orbit coupling of electrons with a non-centrosymmetric crystal lattice lifting spin degeneracy of electron energy and mixing spin and orbital degrees of freedom. The presented calculation of magnetisation induced by current based on the application of kinetic equation for the matrix distribution function of electrons occupying the states in two bands split by the spin-orbit interaction.


title: Cluster Shift Keying: Covert Transmission of Information via Cluster Synchronization in Chaotic Networks

abstract: A network of chaotic systems can be designed in such a way that the cluster patterns formed by synchronous nodes can be controlled through the coupling parameters. We present a novel approach to exploit such a network for covert communication purposes, where controlled clusters encode the symbols spatio-temporally. The cluster synchronization network is divided into two subnetworks as transmitter and receiver. First, we specifically design the network whose controlled parameters reside in the transmitter. Second, we ensure that the nodes of the links connecting the transmitter and receiver are not in the same clusters for all the control parameters. The former condition ensures that the control parameters changed at the transmitter change the whole clustering scheme. The second condition enforces the transmitted signals are always continuous and chaotic. Hence, the transmitted signals are not modulated by the information directly, but distributed over the links connecting the subnetworks. The information cannot be deciphered by eavesdropping on the channel links without knowing the network topology. The performance has been assessed by extensive simulations of bit error rates under noisy channel conditions.


title: FedGeo: Privacy-Preserving User Next Location Prediction with Federated Learning

abstract: A User Next Location Prediction (UNLP) task, which predicts the next location that a user will move to given his/her trajectory, is an indispensable task for a wide range of applications. Previous studies using large-scale trajectory datasets in a single server have achieved remarkable performance in UNLP task. However, in real-world applications, legal and ethical issues have been raised regarding privacy concerns leading to restrictions against sharing human trajectory datasets to any other server. In response, Federated Learning (FL) has emerged to address the personal privacy issue by collaboratively training multiple clients (i.e., users) and then aggregating them. While previous studies employed FL for UNLP, they are still unable to achieve reliable performance because of the heterogeneity of clients' mobility. To tackle this problem, we propose the Federated Learning for Geographic Information (FedGeo), a FL framework specialized for UNLP, which alleviates the heterogeneity of clients' mobility and guarantees personal privacy protection. Firstly, we incorporate prior global geographic adjacency information to the local client model, since the spatial correlation between locations is trained partially in each client who has only a heterogeneous subset of the overall trajectories in FL. We also introduce a novel aggregation method that minimizes the gap between client models to solve the problem of client drift caused by differences between client models when learning with their heterogeneous data. Lastly, we probabilistically exclude clients with extremely heterogeneous data from the FL process by focusing on clients who visit relatively diverse locations. We show that FedGeo is superior to other FL methods for model performance in UNLP task. We also validated our model in a real-world application using our own customers' mobile phones and the FL agent system.


title: Evaluating The Accuracy of Classification Algorithms for Detecting Heart Disease Risk

abstract: The healthcare industry generates enormous amounts of complex clinical data that make the prediction of disease detection a complicated process. In medical informatics, making effective and efficient decisions is very important. Data Mining (DM) techniques are mainly used to identify and extract hidden patterns and interesting knowledge to diagnose and predict diseases in medical datasets. Nowadays, heart disease is considered one of the most important problems in the healthcare field. Therefore, early diagnosis leads to a reduction in deaths. DM techniques have proven highly effective for predicting and diagnosing heart diseases. This work utilizes the classification algorithms with a medical dataset of heart disease; namely, J48, Random Forest, and Na\"ive Bayes to discover the accuracy of their performance. We also examine the impact of the feature selection method. A comparative and analysis study was performed to determine the best technique using Waikato Environment for Knowledge Analysis (Weka) software, version 3.8.6. The performance of the utilized algorithms was evaluated using standard metrics such as accuracy, sensitivity and specificity. The importance of using classification techniques for heart disease diagnosis has been highlighted. We also reduced the number of attributes in the dataset, which showed a significant improvement in prediction accuracy. The results indicate that the best algorithm for predicting heart disease was Random Forest with an accuracy of 99.24%.


title: Feature Analysis of Encrypted Malicious Traffic

abstract: In recent years there has been a dramatic increase in the number of malware attacks that use encrypted HTTP traffic for self-propagation or communication. Antivirus software and firewalls typically will not have access to encryption keys, and therefore direct detection of malicious encrypted data is unlikely to succeed. However, previous work has shown that traffic analysis can provide indications of malicious intent, even in cases where the underlying data remains encrypted. In this paper, we apply three machine learning techniques to the problem of distinguishing malicious encrypted HTTP traffic from benign encrypted traffic and obtain results comparable to previous work. We then consider the problem of feature analysis in some detail. Previous work has often relied on human expertise to determine the most useful and informative features in this problem domain. We demonstrate that such feature-related information can be obtained directly from machine learning models themselves. We argue that such a machine learning based approach to feature analysis is preferable, as it is more reliable, and we can, for example, uncover relatively unintuitive interactions between features.


title: TrustFed: A Reliable Federated Learning Framework with Malicious-Attack Resistance

abstract: As a key technology in 6G research, federated learning (FL) enables collaborative learning among multiple clients while ensuring individual data privacy. However, malicious attackers among the participating clients can intentionally tamper with the training data or the trained model, compromising the accuracy and trustworthiness of the system. To address this issue, in this paper, we propose a hierarchical audit-based FL (HiAudit-FL) framework, with the aim to enhance the reliability and security of the learning process. The hierarchical audit process includes two stages, namely model-audit and parameter-audit. In the model-audit stage, a low-overhead audit method is employed to identify suspicious clients. Subsequently, in the parameter-audit stage, a resource-consuming method is used to detect all malicious clients with higher accuracy among the suspicious ones. Specifically, we execute the model audit method among partial clients for multiple rounds, which is modeled as a partial observation Markov decision process (POMDP) with the aim to enhance the robustness and accountability of the decision-making in complex and uncertain environments. Meanwhile, we formulate the problem of identifying malicious attackers through a multi-round audit as an active sequential hypothesis testing problem and leverage a diffusion model-based AI-Enabled audit selection strategy (ASS) to decide which clients should be audited in each round. To accomplish efficient and effective audit selection, we design a DRL-ASS algorithm by incorporating the ASS in a deep reinforcement learning (DRL) framework. Our simulation results demonstrate that HiAudit-FL can effectively identify and handle potential malicious users accurately, with small system overhead.


title: Formalization of Robot Collision Detection Method based on Conformal Geometric Algebra

abstract: Cooperative robots can significantly assist people in their productive activities, improving the quality of their works. Collision detection is vital to ensure the safe and stable operation of cooperative robots in productive activities. As an advanced geometric language, conformal geometric algebra can simplify the construction of the robot collision model and the calculation of collision distance. Compared with the formal method based on conformal geometric algebra, the traditional method may have some defects which are difficult to find in the modelling and calculation. We use the formal method based on conformal geometric algebra to study the collision detection problem of cooperative robots. This paper builds formal models of geometric primitives and the robot body based on the conformal geometric algebra library in HOL Light. We analyse the shortest distance between geometric primitives and prove their collision determination conditions. Based on the above contents, we construct a formal verification framework for the robot collision detection method. By the end of this paper, we apply the proposed framework to collision detection between two single-arm industrial cooperative robots. The flexibility and reliability of the proposed framework are verified by constructing a general collision model and a special collision model for two single-arm industrial cooperative robots.


title: HD 110067 is a wide hierarchical triple system

abstract: We report that HD 110067, the recently announced host star of a resonant sextuplet of transiting sub-Neptunes, is not a single star as claimed in the discovery paper, but a wide hierarchical triple. The K0 V planet hosting star (V = 8.4 mag, d = 32 pc) has a companion at a wide projected separation of 13400 au. This companion, namely HD 110106, is a slightly fainter (V = 8.8 mag) K3 V type 8-year period double-lined spectroscopic binary. The secondary in this spectroscopic binary is contributing a significant amount of flux and has a measured high mass ratio.


title: Haldane Bundles: A Dataset for Learning to Predict the Chern Number of Line Bundles on the Torus

abstract: Characteristic classes, which are abstract topological invariants associated with vector bundles, have become an important notion in modern physics with surprising real-world consequences. As a representative example, the incredible properties of topological insulators, which are insulators in their bulk but conductors on their surface, can be completely characterized by a specific characteristic class associated with their electronic band structure, the first Chern class. Given their importance to next generation computing and the computational challenge of calculating them using first-principles approaches, there is a need to develop machine learning approaches to predict the characteristic classes associated with a material system. To aid in this program we introduce the {\emph{Haldane bundle dataset}}, which consists of synthetically generated complex line bundles on the $2$-torus. We envision this dataset, which is not as challenging as noisy and sparsely measured real-world datasets but (as we show) still difficult for off-the-shelf architectures, to be a testing ground for architectures that incorporate the rich topological and geometric priors underlying characteristic classes.


title: Estimating Fr\'echet bounds for validating programmatic weak supervision

abstract: We develop methods for estimating Fr\'echet bounds on (possibly high-dimensional) distribution classes in which some variables are continuous-valued. We establish the statistical correctness of the computed bounds under uncertainty in the marginal constraints and demonstrate the usefulness of our algorithms by evaluating the performance of machine learning (ML) models trained with programmatic weak supervision (PWS). PWS is a framework for principled learning from weak supervision inputs (e.g., crowdsourced labels, knowledge bases, pre-trained models on related tasks, etc), and it has achieved remarkable success in many areas of science and engineering. Unfortunately, it is generally difficult to validate the performance of ML models trained with PWS due to the absence of labeled data. Our algorithms address this issue by estimating sharp lower and upper bounds for performance metrics such as accuracy/recall/precision/F1 score.


title: Low-Complexity Channel Estimation for Extremely Large-Scale MIMO in Near Field

abstract: The extremely large-scale massive multiple-input multiple-output (XL-MIMO) has the potential to achieve boosted spectral efficiency and refined spatial resolution for future wireless networks. However, channel estimation for XL-MIMO is challenging since the large number of antennas results in high computational complexity with the near-field effect. In this letter, we propose a low-complexity sequential angle-distance channel estimation (SADCE) method for near-field XL-MIMO systems equipped with uniformly planar arrays (UPA). Specifically, we first successfully decouple the angle and distance parameters, which allows us to devise a two-dimensional discrete Fourier transform (2D-DFT) method for angle parameters estimation. Then, a low-complexity distance estimation method is proposed with a closed-form solution. Compared with existing methods, the proposed method achieves significant performance gain with noticeably reduced computational complexity.Numerical results verify the superiority of the proposed near-field channel estimation algorithm.