title: Surf-CDM: Score-Based Surface Cold-Diffusion Model For Medical Image Segmentation

abstract: Diffusion models have shown impressive performance for image generation, often times outperforming other generative models. Since their introduction, researchers have extended the powerful noise-to-image denoising pipeline to discriminative tasks, including image segmentation. In this work we propose a conditional score-based generative modeling framework for medical image segmentation which relies on a parametric surface representation for the segmentation masks. The surface re-parameterization allows the direct application of standard diffusion theory, as opposed to when the mask is represented as a binary mask. Moreover, we adapted an extended variant of the diffusion technique known as the "cold-diffusion" where the diffusion model can be constructed with deterministic perturbations instead of Gaussian noise, which facilitates significantly faster convergence in the reverse diffusion. We evaluated our method on the segmentation of the left ventricle from 65 transthoracic echocardiogram videos (2230 echo image frames) and compared its performance to the most popular and widely used image segmentation models. Our proposed model not only outperformed the compared methods in terms of segmentation accuracy, but also showed potential in estimating segmentation uncertainties for further downstream analyses due to its inherent generative nature.


title: A laboratory-based X-ray phase contrast microscopy system for targeting in unstained soft-tissue samples

abstract: We propose an imaging system and methodology for mapping soft-tissue samples in three dimensions, with micron-scale and isotropic spatial resolution, with low-concentrations as well as in the absence of heavy metal staining. We used hard X-ray phase-contrast imaging for the X-ray ability to non-destructively probe the internal structure of opaque specimens and for enhanced contrast obtained by exploiting phase effects, even in cases with reduced or absent staining agents. To demonstrate its applicability to soft-tissue specimens, we built a compact system that is easily deployable in a laboratory setting. The imaging system is based on a conventional rotating anode X-ray tube and a state-of-the-art custom-made radiation detector. The system's performance is quantitatively assessed on a calibration standard. Its potential for soft-tissue microscopy is demonstrated on two biological specimens and benchmarked against gold-standard synchrotron data. We believe that the approach proposed here can be valuable as a bridging imaging modality for intravital correlative light electron microscopy and be applied across disciplines where the three-dimensional morphology of pristine-condition soft tissues is a key element of the investigation.


title: Toxic Bias: Perspective API Misreads German as More Toxic

abstract: Proprietary public APIs play a crucial and growing role as research tools among social scientists. Among such APIs, Google's machine learning-based Perspective API is extensively utilized for assessing the toxicity of social media messages, providing both an important resource for researchers and automatic content moderation. However, this paper exposes an important bias in Perspective API concerning German language text. Through an in-depth examination of several datasets, we uncover intrinsic language biases within the multilingual model of Perspective API. We find that the toxicity assessment of German content produces significantly higher toxicity levels than other languages. This finding is robust across various translations, topics, and data sources, and has significant consequences for both research and moderation strategies that rely on Perspective API. For instance, we show that, on average, four times more tweets and users would be moderated when using the German language compared to their English translation. Our findings point to broader risks associated with the widespread use of proprietary APIs within the computational social sciences.


title: Aberration correction in epi-fluorescence microscopy using unknown speckle illumination

abstract: Diffraction-limited imaging in epi-fluorescence microscopy remains a challenge when sample aberrations are present or when the region of interest rests deep within an inhomogeneous medium. Adaptive optics is an attractive solution albeit with limited field of view and requiring relatively complicated systems. Alternatively, reconstruction algorithms have been developed over the years to correct for aberrations. Unfortunately, purely postprocessing techniques tend to be ill-posed and provide only incremental improvements in image quality. Here, we report a computational optical approach using unknown speckle illumination and matched reconstruction algorithm to correct for aberrations and reach or surpass diffraction limited resolution. The data acquisition is performed by shifting an unknown speckle pattern with respect to the fluorescent object. The method recovers simultaneously a high-resolution image, the point spread function of the system that contains the aberrations, the speckle illumination pattern, and the shift positions.


title: Diagnosis Of Takotsubo Syndrome By Robust Feature Selection From The Complex Latent Space Of DL-based Segmentation Network

abstract: Researchers have shown significant correlations among segmented objects in various medical imaging modalities and disease related pathologies. Several studies showed that using hand crafted features for disease prediction neglects the immense possibility to use latent features from deep learning (DL) models which may reduce the overall accuracy of differential diagnosis. However, directly using classification or segmentation models on medical to learn latent features opt out robust feature selection and may lead to overfitting. To fill this gap, we propose a novel feature selection technique using the latent space of a segmentation model that can aid diagnosis. We evaluated our method in differentiating a rare cardiac disease: Takotsubo Syndrome (TTS) from the ST elevation myocardial infarction (STEMI) using echocardiogram videos (echo). TTS can mimic clinical features of STEMI in echo and extremely hard to distinguish. Our approach shows promising results in differential diagnosis of TTS with 82% diagnosis accuracy beating the previous state-of-the-art (SOTA) approach. Moreover, the robust feature selection technique using LASSO algorithm shows great potential in reducing the redundant features and creates a robust pipeline for short- and long-term disease prognoses in the downstream analysis.


title: FairFlow Protocol: Equitable Maximal Extractable Value (MEV) mitigation in Ethereum

abstract: Ethereum has emerged as a leading platform for decentralized applications (dApps) due to its robust smart contract capabilities. One of the critical issues in the Ethereum ecosystem is Maximal Extractable Value (MEV), a concept that has gained significant attention in the blockchain community. However, MEV has remained a major challenge with significant implications for the platform's operation and integrity. This paper introduces the FairFlow protocol, a novel framework designed to mitigate the effects of MEV within Ethereum's existing infrastructure. The protocol aims to provide a more equitable environment, preventing exploitation by miners or validators, and protecting user data. The combined approach of auction-based block space allocation and randomized transaction ordering significantly reduces the potential for MEV exploitation.


title: Can Transformers Learn Sequential Function Classes In Context?

abstract: In-context learning (ICL) has revolutionized the capabilities of transformer models in NLP. In our project, we extend the understanding of the mechanisms underpinning ICL by exploring whether transformers can learn from sequential, non-textual function class data distributions. We introduce a novel sliding window sequential function class and employ toy-sized transformers with a GPT-2 architecture to conduct our experiments. Our analysis indicates that these models can indeed leverage ICL when trained on non-textual sequential function classes. Additionally, our experiments with randomized y-label sequences highlights that transformers retain some ICL capabilities even when the label associations are obfuscated. We provide evidence that transformers can reason with and understand sequentiality encoded within function classes, as reflected by the effective learning of our proposed tasks. Our results also show that the performance deteriorated with increasing randomness in the labels, though not to the extent one might expect, implying a potential robustness of learned sequentiality against label noise. Future research may want to look into how previous explanations of transformers, such as induction heads and task vectors, relate to sequentiality in ICL in these toy examples. Our investigation lays the groundwork for further research into how transformers process and perceive sequential data.


title: Transport manifestations of fluctuation-induced effects in dissipative impurities

abstract: We investigate the transport properties of a quantum wire of weakly interacting fermions in the presence of a dissipative impurity. We calculate current and conductance in this system due to applied external chemical potential bias that can be measured in experimental realizations of ultracold fermions in quasi one-dimensional traps. Using a Keldysh field theory approach based on the Lindblad equation, we establish a perturbative scheme to study the effect of imbalanced reservoirs. Logarithmically divergent terms are resummed using a renormalization group method, and a novel power-law behavior for the conductance as a function of the potential bias across the wire is found. In contrast to the equilibrium case of a potential barrier in a Luttinger liquid, the conductance exhibits a scaling behavior, which depends on the interaction strength and on the loss probability. Repulsive interactions reduce the conductance of the wire while attractive interactions enhance it. However, perfect reflectivity and transparency are only reached in the absence of dissipation.


title: The Convex Landscape of Neural Networks: Characterizing Global Optima and Stationary Points via Lasso Models

abstract: Due to the non-convex nature of training Deep Neural Network (DNN) models, their effectiveness relies on the use of non-convex optimization heuristics. Traditional methods for training DNNs often require costly empirical methods to produce successful models and do not have a clear theoretical foundation. In this study, we examine the use of convex optimization theory and sparse recovery models to refine the training process of neural networks and provide a better interpretation of their optimal weights. We focus on training two-layer neural networks with piecewise linear activations and demonstrate that they can be formulated as a finite-dimensional convex program. These programs include a regularization term that promotes sparsity, which constitutes a variant of group Lasso. We first utilize semi-infinite programming theory to prove strong duality for finite width neural networks and then we express these architectures equivalently as high dimensional convex sparse recovery models. Remarkably, the worst-case complexity to solve the convex program is polynomial in the number of samples and number of neurons when the rank of the data matrix is bounded, which is the case in convolutional networks. To extend our method to training data of arbitrary rank, we develop a novel polynomial-time approximation scheme based on zonotope subsampling that comes with a guaranteed approximation ratio. We also show that all the stationary of the nonconvex training objective can be characterized as the global optimum of a subsampled convex program. Our convex models can be trained using standard convex solvers without resorting to heuristics or extensive hyper-parameter tuning unlike non-convex methods. Through extensive numerical experiments, we show that convex models can outperform traditional non-convex methods and are not sensitive to optimizer hyperparameters.


title: On the evolutionary nature of puffed-up stripped star binaries and their occurrence in stellar populations

abstract: The majority of massive stars are formed in multiple systems and will interact with companions via mass transfer. This interaction typically leads to the primary shedding its envelope and the formation of a "stripped star". Classically, stripped stars are expected to quickly contract to become hot UV-bright helium stars. Surprisingly, recent optical surveys have unveiled a large number of stripped stars that are larger and cooler, appearing "puffed-up" and overlapping with the Main Sequence (MS). Here, we study the evolutionary nature and lifetimes of puffed-up stripped (PS) stars using stellar-evolution code MESA. We computed grids of binary models at four metallicities from Z = 0.017 to 0.0017. Contrary to previous assumptions, we find that stripped stars regain thermal equilibrium shortly after the end of mass transfer. Their further contraction is determined by the rate at which the residual H-rich envelope is depleted, with the main agents being H-shell burning (dominant) and mass-loss in winds. The duration of the PS star phase is 1$\%$ of the total lifetime and up to 100 times more than thermal timescale. We explored several relevant factors: orbital period, mass ratio, winds, and semiconvection. We carried out a simple population estimation, finding that $\sim$0.5-0.7 $\%$ of all the stars with $\log (L/L_{\rm \odot}$) $>$ 3.7 are PS stars. Our results indicate that tens to hundred of PS stars may be hiding in the MS population, disguised as normal stars: $\sim$100 in the Small Magellanic Cloud alone. Their true nature may be revealed by low surface gravities, high N enrichment, and likely slow rotations


title: Expediting Contrastive Language-Image Pretraining via Self-distilled Encoders

abstract: Recent advances in vision language pretraining (VLP) have been largely attributed to the large-scale data collected from the web. However, uncurated dataset contains weakly correlated image-text pairs, causing data inefficiency. To address the issue, knowledge distillation have been explored at the expense of extra image and text momentum encoders to generate teaching signals for misaligned image-text pairs. In this paper, our goal is to resolve the misalignment problem with an efficient distillation framework. To this end, we propose ECLIPSE: Expediting Contrastive Language-Image Pretraining with Self-distilled Encoders. ECLIPSE features a distinctive distillation architecture wherein a shared text encoder is utilized between an online image encoder and a momentum image encoder. This strategic design choice enables the distillation to operate within a unified projected space of text embedding, resulting in better performance. Based on the unified text embedding space, ECLIPSE compensates for the additional computational cost of the momentum image encoder by expediting the online image encoder. Through our extensive experiments, we validate that there is a sweet spot between expedition and distillation where the partial view from the expedited online image encoder interacts complementarily with the momentum teacher. As a result, ECLIPSE outperforms its counterparts while achieving substantial acceleration in inference speed.


title: Is post-editing really faster than human translation?

abstract: Time efficiency is paramount for the localisation industry, which demands ever-faster turnaround times. However, translation speed is largely underresearched, and there is a lack of clarity about how language service providers (LSPs) can evaluate the performance of their post-editing (PE) and human translation (HT) services. This study constitutes the first large-scale investigation of translation and revision speed in HT and in the PE of neural machine translation, based on real-world data from an LSP. It uses an exploratory data analysis approach to investigate data for 90 million words translated by 879 linguists across 11 language pairs, over 2.5 years. The results of this research indicate that (a) PE is usually but not always faster than HT; (b) average speed values may be misleading; (c) translation speed is highly variable; and (d) edit distance cannot be used as a proxy for post-editing productivity, because it does not correlate strongly with speed.


title: Misalign, Contrast then Distill: Rethinking Misalignments in Language-Image Pretraining

abstract: Contrastive Language-Image Pretraining has emerged as a prominent approach for training vision and text encoders with uncurated image-text pairs from the web. To enhance data-efficiency, recent efforts have introduced additional supervision terms that involve random-augmented views of the image. However, since the image augmentation process is unaware of its text counterpart, this procedure could cause various degrees of image-text misalignments during training. Prior methods either disregarded this discrepancy or introduced external models to mitigate the impact of misalignments during training. In contrast, we propose a novel metric learning approach that capitalizes on these misalignments as an additional training source, which we term "Misalign, Contrast then Distill (MCD)". Unlike previous methods that treat augmented images and their text counterparts as simple positive pairs, MCD predicts the continuous scales of misalignment caused by the augmentation. Our extensive experimental results show that our proposed MCD achieves state-of-the-art transferability in multiple classification and retrieval downstream datasets.


title: The Batchelor-Howells-Townsend spectrum: large velocity case

abstract: We consider the behaviour of a passive tracer $\theta$ governed by $\partial_t\theta + u\cdot\nabla\theta = \Delta\theta + g$ in two space dimensions with prescribed smooth random incompressible velocity $u(x,t)$ and source $g(x)$. In 1959, Batchelor, Howells and Townsend (J.\ Fluid Mech.\ 5:113) predicted that the tracer (power) spectrum should then scale as $|\theta_k|^2\propto|k|^{-4}|u_k|^2$ for $|k|$ large depending on the velocity $u$. For smaller $|k|$, Obukhov and Corrsin earlier predicted a different spectral scaling. In this paper, we prove that the BHT scaling does indeed hold probabilistically for sufficiently large $|k|$, asymptotically up to controlled remainders, using only bounds on the smaller $|k|$ component.


title: 20 years of Greedy Randomized Adaptive Search Procedures with Path Relinking

abstract: This is a comprehensive review of the Greedy Randomized Adaptive Search Procedure (GRASP) metaheuristic and its hybridization with Path Relinking (PR) over the past two decades. GRASP with PR has become a widely adopted approach for solving hard optimization problems since its proposal in 1999. The paper covers the historical development of GRASP with PR and its theoretical foundations, as well as recent advances in its implementation and application. The review includes a critical analysis of variants of PR, including memory-based and randomized designs, with a total of ten different implementations. It describes these advanced designs both theoretically and practically on two well-known optimization problems, linear ordering and max-cut. The paper also explores the hybridization of GRASP with PR and other metaheuristics, such as Tabu Search and Scatter Search. Overall, this review provides valuable insights for researchers and practitioners seeking to utilize GRASP with PR for solving optimization problems.


title: UnionDet: Union-Level Detector Towards Real-Time Human-Object Interaction Detection

abstract: Recent advances in deep neural networks have achieved significant progress in detecting individual objects from an image. However, object detection is not sufficient to fully understand a visual scene. Towards a deeper visual understanding, the interactions between objects, especially humans and objects are essential. Most prior works have obtained this information with a bottom-up approach, where the objects are first detected and the interactions are predicted sequentially by pairing the objects. This is a major bottleneck in HOI detection inference time. To tackle this problem, we propose UnionDet, a one-stage meta-architecture for HOI detection powered by a novel union-level detector that eliminates this additional inference stage by directly capturing the region of interaction. Our one-stage detector for human-object interaction shows a significant reduction in interaction prediction time 4x~14x while outperforming state-of-the-art methods on two public datasets: V-COCO and HICO-DET.


title: A new light at the end of the tunnel: fiber gas discharge lasers

abstract: Optical fibers have emerged as a transformative platform for building better and more robust solid state lasers. However, the wavelengths available to these lasers are limited. Using hollow core optical fibers allows us to add gases as new potential gain media for fiber lasers, and also liberates the gas laser from the limits normally imposed by diffraction. To demonstrate the new technology, we present a fiber laser at 3500 nm wavelength, using an antiresonant guiding hollow core optical fiber containing neutral xenon atoms pumped by an afterglow discharge of a helium-xenon mixture within a fiber of over 1 m in length. Laser action is confirmed through observation of polarization dependence, mode pulling and mode beating. Our results unlock a new breed of flexible fiber lasers operating at a plethora of wavelengths, many previous unavailable.


title: Incremental Semi-supervised Federated Learning for Health Inference via Mobile Sensing

abstract: Mobile sensing appears as a promising solution for health inference problem (e.g., influenza-like symptom recognition) by leveraging diverse smart sensors to capture fine-grained information about human behaviors and ambient contexts. Centralized training of machine learning models can place mobile users' sensitive information under privacy risks due to data breach and misexploitation. Federated Learning (FL) enables mobile devices to collaboratively learn global models without the exposure of local private data. However, there are challenges of on-device FL deployment using mobile sensing: 1) long-term and continuously collected mobile sensing data may exhibit domain shifts as sensing objects (e.g. humans) have varying behaviors as a result of internal and/or external stimulus; 2) model retraining using all available data may increase computation and memory burden; and 3) the sparsity of annotated crowd-sourced data causes supervised FL to lack robustness. In this work, we propose FedMobile, an incremental semi-supervised federated learning algorithm, to train models semi-supervisedly and incrementally in a decentralized online fashion. We evaluate FedMobile using a real-world mobile sensing dataset for influenza-like symptom recognition. Our empirical results show that FedMobile-trained models achieve the best results in comparison to the selected baseline methods.


title: Discovering Malicious Signatures in Software from Structural Interactions

abstract: Malware represents a significant security concern in today's digital landscape, as it can destroy or disable operating systems, steal sensitive user information, and occupy valuable disk space. However, current malware detection methods, such as static-based and dynamic-based approaches, struggle to identify newly developed (``zero-day") malware and are limited by customized virtual machine (VM) environments. To overcome these limitations, we propose a novel malware detection approach that leverages deep learning, mathematical techniques, and network science. Our approach focuses on static and dynamic analysis and utilizes the Low-Level Virtual Machine (LLVM) to profile applications within a complex network. The generated network topologies are input into the GraphSAGE architecture to efficiently distinguish between benign and malicious software applications, with the operation names denoted as node features. Importantly, the GraphSAGE models analyze the network's topological geometry to make predictions, enabling them to detect state-of-the-art malware and prevent potential damage during execution in a VM. To evaluate our approach, we conduct a study on a dataset comprising source code from 24,376 applications, specifically written in C/C++, sourced directly from widely-recognized malware and various types of benign software. The results show a high detection performance with an Area Under the Receiver Operating Characteristic Curve (AUROC) of 99.85%. Our approach marks a substantial improvement in malware detection, providing a notably more accurate and efficient solution when compared to current state-of-the-art malware detection methods.


title: Convolutional Channel-wise Competitive Learning for the Forward-Forward Algorithm

abstract: The Forward-Forward (FF) Algorithm has been recently proposed to alleviate the issues of backpropagation (BP) commonly used to train deep neural networks. However, its current formulation exhibits limitations such as the generation of negative data, slower convergence, and inadequate performance on complex tasks. In this paper, we take the main ideas of FF and improve them by leveraging channel-wise competitive learning in the context of convolutional neural networks for image classification tasks. A layer-wise loss function is introduced that promotes competitive learning and eliminates the need for negative data construction. To enhance both the learning of compositional features and feature space partitioning, a channel-wise feature separator and extractor block is proposed that complements the competitive learning process. Our method outperforms recent FF-based models on image classification tasks, achieving testing errors of 0.58%, 7.69%, 21.89%, and 48.77% on MNIST, Fashion-MNIST, CIFAR-10 and CIFAR-100 respectively. Our approach bridges the performance gap between FF learning and BP methods, indicating the potential of our proposed approach to learn useful representations in a layer-wise modular fashion, enabling more efficient and flexible learning.


title: Holographic description for correlation functions

abstract: We study general correlation functions of various quantum field theories in the holographic setup. Following the holographic proposal, we investigate correlation functions via a geodesic length connecting boundary operators. We show that this holographic description can reproduce the known two- and three-point functions of conformal field theory. Using this holographic method, we further study general two-point functions of a two-dimensional thermal CFT and of a scalar field theory living in a dS or AdS space. Due to the nontrivial thermal or curvature effect, the two-point functions in an IR limit show different scaling behaviors from those of the UV CFT. We study such nontrivial IR scaling behaviors by applying the holographic method.


title: On the Role of Server Momentum in Federated Learning

abstract: Federated Averaging (FedAvg) is known to experience convergence issues when encountering significant clients system heterogeneity and data heterogeneity. Server momentum has been proposed as an effective mitigation. However, existing server momentum works are restrictive in the momentum formulation, do not properly schedule hyperparameters and focus only on system homogeneous settings, which leaves the role of server momentum still an under-explored problem. In this paper, we propose a general framework for server momentum, that (a) covers a large class of momentum schemes that are unexplored in federated learning (FL), (b) enables a popular stagewise hyperparameter scheduler, (c) allows heterogeneous and asynchronous local computing. We provide rigorous convergence analysis for the proposed framework. To our best knowledge, this is the first work that thoroughly analyzes the performances of server momentum with a hyperparameter scheduler and system heterogeneity. Extensive experiments validate the effectiveness of our proposed framework.


title: Controllable chiral light generation and vortex field investigation using plasmonic holes revealed by cathodoluminescence

abstract: Control of the angular momentum of light is a key technology for next-generation nano-optical devices and optical communications, including quantum communication and encoding. We propose an approach to controllably generate circularly polarized light from a circular hole in a metal film using an electron beam by coherently exciting transition radiation and light scattering from the hole through surface plasmon polaritons. The circularly polarized light generation is confirmed by fully polarimetric four-dimensional cathodoluminescence mapping where angle-resolved spectra are simultaneously obtained. The obtained intensity and Stokes maps show clear interference fringes as well as almost fully circularly polarized light generation with controllable parities by electron beam position. By applying this approach to a metal film with three holes, a vortex field with a phase singularity is visualized in the middle of the holes.


title: Categorical, Ratio, and Professorial Data: The Case for Reciprocal Rank

abstract: Search engine results pages are usually abstracted as binary relevance vectors and hence are categorical data, meaning that only a limited set of operations is permitted, most notably tabulation of occurrence frequencies, with determination of medians and averages not possible. To compare retrieval systems it is thus usual to make use of a categorical-to-numeric effectiveness mapping. A previous paper has argued that any desired categorical-to-numeric mapping may be used, provided only that there is an argued connection between each category of SERP and the score that is assigned to that category by the mapping. Further, once that plausible connection has been established, then the mapped values can be treated as real-valued observations on a ratio scale, allowing the computation of averages. This article is written in support of that point of view, and to respond to ongoing claims that SERP scores may only be averaged if very restrictive conditions are imposed on the effectiveness mapping.


title: Structure of lower tails in sparse random graphs

abstract: We study the typical structure of a sparse Erd\H{o}s--R\'enyi random graph conditioned on the lower tail subgraph count event. We show that in certain regimes, a typical graph sampled from the conditional distribution resembles the entropy minimizer of the mean field approximation in the sense of both subgraph counts and cut norm. The main ingredients are an adaptation of an entropy increment scheme of Kozma and Samotij, and a new stability for the solution of the associated entropy variational problem. Our proof suggests a more general framework for establishing typical behavior statements when the objects of interest can be encoded in a hypergraph satisfying mild degree conditions.


title: Automated Estimation of Plasma Temperature and Density from Emission Spectroscopy

abstract: This paper introduces a novel approach for automated estimation of plasma temperature and density using emission spectroscopy, integrating Bayesian inference with sophisticated physical models. We provide an in-depth examination of Bayesian methods applied to the complexities of plasma diagnostics, supported by a robust framework of physical and measurement models. Our methodology is validated through experimental observations, focusing on individual and sequential shot analyses. The results demonstrate the effectiveness of our approach in enhancing the accuracy and reliability of plasma parameter estimation, marking a significant advancement in the field of emission spectroscopy for plasma diagnostics. This study not only offers a new perspective in plasma analysis but also paves the way for further research and applications in nuclear instrumentation and related domains.


title: Comparison of Waymo Rider-Only Crash Data to Human Benchmarks at 7.1 Million Miles

abstract: This paper examines the safety performance of the Waymo Driver, an SAE level 4 automated driving system (ADS) used in a rider-only (RO) ride-hailing application without a human driver, either in the vehicle or remotely. ADS crash data was derived from NHTSA's Standing General Order (SGO) reporting over 7.14 million RO miles through the end of October 2023 in Phoenix, AZ, San Francisco, CA, and Los Angeles, CA. This study is one of the first to compare overall crashed vehicle rates using only RO data (as opposed to ADS testing with a human behind the wheel) to a human benchmark that also corrects for biases caused by underreporting and unequal reporting thresholds reported in the literature. When considering all locations together, the any-injury-reported crashed vehicle rate was 0.41 incidents per million miles (IPMM) for the ADS vs 2.78 IPMM for the human benchmark, an 85% reduction or a 6.8 times lower rate. Police-reported crashed vehicle rates for all locations together were 2.1 IPMM for the ADS vs. 4.85 IPMM for the human benchmark, a 57% reduction or 2.3 times lower rate. Police-reported and any-injury-reported crashed vehicle rate reductions for the ADS were statistically significant when compared in San Francisco and Phoenix as well as combined across all locations. The comparison in Los Angeles, which to date has low mileage and no reported events, was not statistically significant. In general, the Waymo ADS had a lower any property damage or injury rate than the human benchmarks. Given imprecision in the benchmark estimate and multiple potential sources of underreporting biasing the benchmarks, caution should be taken when interpreting the results of the any property damage or injury comparison. Together, these crash-rate results should be interpreted as a directional and continuous confidence growth indicator, together with other methodologies, in a safety case approach.


title: Combinatorial Gaussian Process Bandits in Bayesian Settings: Theory and Application for Energy-Efficient Navigation

abstract: We consider a combinatorial Gaussian process semi-bandit problem with time-varying arm availability. Each round, an agent is provided a set of available base arms and must select a subset of them to maximize the long-term cumulative reward. Assuming the expected rewards are sampled from a Gaussian process (GP) over the arm space, the agent can efficiently learn. We study the Bayesian setting and provide novel Bayesian regret bounds for three GP-based algorithms: GP-UCB, Bayes-GP-UCB and GP-TS. Our bounds extend previous results for GP-UCB and GP-TS to a combinatorial setting with varying arm availability and to the best of our knowledge, we provide the first Bayesian regret bound for Bayes-GP-UCB. Time-varying arm availability encompasses other widely considered bandit problems such as contextual bandits. We formulate the online energy-efficient navigation problem as a combinatorial and contextual bandit and provide a comprehensive experimental study on synthetic and real-world road networks with detailed simulations. The contextual GP model obtains lower regret and is less dependent on the informativeness of the prior compared to the non-contextual Bayesian inference model. In addition, Thompson sampling obtains lower regret than Bayes-UCB for both the contextual and non-contextual model.


title: Synchronous Consensus in Partial Synchrony

abstract: We demonstrate a deterministic Byzantine consensus algorithm with synchronous operation in partial synchrony. It is naturally leaderless, tolerates any number of $ f<n/2 $ Byzantine processes with 2 rounds of exchange of originator-only signed messages, and terminates within a bounded interval of time. The algorithm is resilient to transient faults and asynchrony in a fraction of links with known size per number of faulty processes. It circumvents asynchronous and faulty links with 3-hop epidemic dissemination. Key finding: the resilience to asynchrony of links and the enabled by it leaderless consensus in partial synchrony ensure algorithm operation with simultaneous validity, safety, and bounded liveness.


title: Causal Discovery for fMRI data: Challenges, Solutions, and a Case Study

abstract: Designing studies that apply causal discovery requires navigating many researcher degrees of freedom. This complexity is exacerbated when the study involves fMRI data. In this paper we (i) describe nine challenges that occur when applying causal discovery to fMRI data, (ii) discuss the space of decisions that need to be made, (iii) review how a recent case study made those decisions, (iv) and identify existing gaps that could potentially be solved by the development of new methods. Overall, causal discovery is a promising approach for analyzing fMRI data, and multiple successful applications have indicated that it is superior to traditional fMRI functional connectivity methods, but current causal discovery methods for fMRI leave room for improvement.


title: Towards Efficient Verification of Quantized Neural Networks

abstract: Quantization replaces floating point arithmetic with integer arithmetic in deep neural network models, providing more efficient on-device inference with less power and memory. In this work, we propose a framework for formally verifying properties of quantized neural networks. Our baseline technique is based on integer linear programming which guarantees both soundness and completeness. We then show how efficiency can be improved by utilizing gradient-based heuristic search methods and also bound-propagation techniques. We evaluate our approach on perception networks quantized with PyTorch. Our results show that we can verify quantized networks with better scalability and efficiency than the previous state of the art.


title: Trajectory Approximation of Video Based on Phase Correlation for Forward Facing Camera

abstract: In this paper, we introduce an innovative approach for extracting trajectories from a camera sensor in GPS-denied environments, leveraging visual odometry. The system takes video footage captured by a forward-facing camera mounted on a vehicle as input, with the output being a chain code representing the camera's trajectory. The proposed methodology involves several key steps. Firstly, we employ phase correlation between consecutive frames of the video to extract essential information. Subsequently, we introduce a novel chain code method termed "dynamic chain code," which is based on the x-shift values derived from the phase correlation. The third step involves determining directional changes (forward, left, right) by establishing thresholds and extracting the corresponding chain code. This extracted code is then stored in a buffer for further processing. Notably, our system outperforms traditional methods reliant on spatial features, exhibiting greater speed and robustness in noisy environments. Importantly, our approach operates without external camera calibration information. Moreover, by incorporating visual odometry, our system enhances its accuracy in estimating camera motion, providing a more comprehensive understanding of trajectory dynamics. Finally, the system culminates in the visualization of the normalized camera motion trajectory.


title: Imitation of Life: A Search Engine for Biologically Inspired Design

abstract: Biologically Inspired Design (BID), or Biomimicry, is a problem-solving methodology that applies analogies from nature to solve engineering challenges. For example, Speedo engineers designed swimsuits based on shark skin. Finding relevant biological solutions for real-world problems poses significant challenges, both due to the limited biological knowledge engineers and designers typically possess and to the limited BID resources. Existing BID datasets are hand-curated and small, and scaling them up requires costly human annotations. In this paper, we introduce BARcode (Biological Analogy Retriever), a search engine for automatically mining bio-inspirations from the web at scale. Using advances in natural language understanding and data programming, BARcode identifies potential inspirations for engineering challenges. Our experiments demonstrate that BARcode can retrieve inspirations that are valuable to engineers and designers tackling real-world problems, as well as recover famous historical BID examples. We release data and code; we view BARcode as a step towards addressing the challenges that have historically hindered the practical application of BID to engineering innovation.


title: Mini-GPTs: Efficient Large Language Models through Contextual Pruning

abstract: In AI research, the optimization of Large Language Models (LLMs) remains a significant challenge, crucial for advancing the field's practical applications and sustainability. Building upon the foundational work of Professor Song Han's lab at MIT, this paper introduces a novel approach in developing Mini-GPTs via contextual pruning. Our methodology strategically prunes the computational architecture of traditional LLMs, like Phi-1.5, focusing on retaining core functionalities while drastically reducing model sizes. We employ the technique across diverse and complex datasets, including US law, Medical Q&A, Skyrim dialogue, English-Taiwanese translation, and Economics articles. The results underscore the efficiency and effectiveness of contextual pruning, not merely as a theoretical concept but as a practical tool in developing domain-specific, resource-efficient LLMs. Contextual pruning is a promising method for building domain-specific LLMs, and this research is a building block towards future development with more hardware compute, refined fine-tuning, and quantization.


title: Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?

abstract: The vast majority of today's large language models are English-centric, having been pretrained predominantly on English text. Yet, in order to meet user expectations, models need to be able to respond appropriately in multiple languages once deployed in downstream applications. Given limited exposure to other languages during pretraining, cross-lingual transfer is important for achieving decent performance in non-English settings. In this work, we investigate just how much multilinguality is required during finetuning to elicit strong cross-lingual generalisation across a range of tasks and target languages. We find that, compared to English-only finetuning, multilingual instruction tuning with as few as three languages significantly improves a model's cross-lingual transfer abilities on generative tasks that assume input/output language agreement, while being of less importance for highly structured tasks. Our code and data is available at https://github.com/ZurichNLP/multilingual-instruction-tuning.


title: On the Lagrangian multiform structure of the extended lattice Boussinesq system

abstract: The lattice Boussinesq (lBSQ) equation is a member of the lattice Gel'fand-Dikii (lGD) hierarchy, introduced in \cite{NijPapCapQui1992}, which is an infinite family of integrable systems of partial difference equations labelled by an integer $N$, where $N=2$ represents the lattice Korteweg-de Vries (KdV) system, and $N=3$ the Boussinesq system. In \cite{Hiet2011} it was shown that, written as three-component system, the lBSQ system allows for extra parameters which essentially amounts to building the lattice KdV inside the lBSQ. In this paper we show that, on the level of the Lagrangian structure, this boils down to a linear combination of Lagrangians from the members of the lGD hierarchy as was established in \cite{LobbNijGD2010}. The corresponding Lagrangian multiform structure is shown to exhibit a `double zero' structure.


title: Using monodromy to recover symmetries of polynomial systems

abstract: Galois/monodromy groups attached to parametric systems of polynomial equations provide a method for detecting the existence of symmetries in solution sets. Beyond the question of existence, one would like to compute formulas for these symmetries, towards the eventual goal of solving the systems more efficiently. We describe and implement one possible approach to this task using numerical homotopy continuation and multivariate rational function interpolation. We describe additional methods that detect and exploit a priori unknown quasi-homogeneous structure in symmetries. These methods extend the range of interpolation to larger examples, including applications with nonlinear symmetries drawn from vision and robotics.


title: Gentle Introduction of Unitary Cohomology Vanishing

abstract: This paper presents a gentle introduction to cohomology vanishing theorems, largely based on the paper work of Hongshan Li. It offers an insightful exploration of unitary local systems on complex manifolds, particularly focusing on their characteristics near normal crossing divisors. The Main Vanishing Theorem, demonstrating the vanishing of specific cohomology groups associated with unitary local systems, stands as a central result in this work. In our exposition, we delve into the interplay between local system theory, Hodge theory, and the geometry of complex manifolds. The canonical extensions of unitary local systems are examined in detail, providing a deeper understanding of their algebraic and geometric properties. The foundational aspects of these systems are thoroughly discussed, culminating in an in-depth analysis of their spectral sequences and the behavior of associated de Rham complexes. A pivotal aspect of the paper is the exploration of the spectral sequence associated with the Hodge filtration on de Rham complexes. Here, we establish its degeneration at the E1 stage and its implications for cohomology groups. This work also encompasses a thorough examination of the properties of Higgs bundles, particularly in the context of parabolic structures and semistability. The amalgamation of these diverse concepts and techniques contributes to a broader understanding of the complex interdependencies in the realm of unitary local systems and their cohomological properties.


title: A Distributed Solution for Efficient K Shortest Paths Computation over Dynamic Road Networks

abstract: The problem of identifying the k-shortest paths KSPs for short in a dynamic road network is essential to many location-based services. Road networks are dynamic in the sense that the weights of the edges in the corresponding graph constantly change over time, representing evolving traffic conditions. Very often such services have to process numerous KSP queries over large road networks at the same time, thus there is a pressing need to identify distributed solutions for this problem. However, most existing approaches are designed to identify KSPs on a static graph in a sequential manner, restricting their scalability and applicability in a distributed setting. We therefore propose KSP-DG, a distributed algorithm for identifying k-shortest paths in a dynamic graph. It is based on partitioning the entire graph into smaller subgraphs, and reduces the problem of determining KSPs into the computation of partial KSPs in relevant subgraphs, which can execute in parallel on a cluster of servers. A distributed two-level index called DTLP is developed to facilitate the efficient identification of relevant subgraphs. A salient feature of DTLP is that it indexes a set of virtual paths that are insensitive to varying traffic conditions in an efficient and compact fashion, leading to very low maintenance cost in dynamic road networks. This is the first treatment of the problem of processing KSP queries over dynamic road networks. Extensive experiments conducted on real road networks confirm the superiority of our proposal over baseline methods.


title: ODIN: Object Density Aware Index for CkNN Queries over Moving Objects on Road Networks

abstract: We study the problem of processing continuous k nearest neighbor (CkNN) queries over moving objects on road networks, which is an essential operation in a variety of applications. We are particularly concerned with scenarios where the object densities in different parts of the road network evolve over time as the objects move. Existing methods on CkNN query processing are ill-suited for such scenarios as they utilize index structures with fixed granularities and are thus unable to keep up with the evolving object densities. In this paper, we directly address this problem and propose an object density aware index structure called ODIN that is an elastic tree built on a hierarchical partitioning of the road network. It is equipped with the unique capability of dynamically folding/unfolding its nodes, thereby adapting to varying object densities. We further present the ODIN-KNN-Init and ODIN-KNN-Inc algorithms for the initial identification of the kNNs and the incremental update of query result as objects move. Thorough experiments on both real and synthetic datasets confirm the superiority of our proposal over several baseline methods.


title: Schwinger-Unruh-Hawking radiation on manifolds

abstract: The whole picture of gauge theory is described by manifolds, while the field equation provides only a part (a section) of the manifold. Just as a three-dimensional object is reconstructed from two planar images, a monopole is constructed by combining two solutions. The Schwinger and the Unruh effects and the Hawking radiation are the production of particles out of the ``vacuum''. If the '''vacuum'' on the manifold is properly defined, these phenomena should be described as local phenomena. However, calculations using the field equations have so far resulted in unnatural extrapolations. We present a method for properly defining the ``vacuum'' and explain how to resolve the local particle production on manifolds. By defining the Stokes phenomena on the manifold, the Schwinger effect is naturally accompanied by the Unruh effect. Also, unlike the conventional Unruh effect, calculations on manifolds do not suffer from the entanglement between disconnected wedges.


title: Determinantal structure of the overlaps for induced spherical unitary ensemble

abstract: In this note, we study the determinantal structure of the $k$-th conditional expectation of the overlap for induced spherical unitary ensemble. We will show the universality for the scaling limits of the $k$-the conditional expectation of the overlap in the three regimes, strongly non-unitary, weakly non-unitary, and the singular origin regimes. As a consequence, we will confirm the universality for the overlap.


title: How Good Are Deep Generative Models for Solving Inverse Problems?

abstract: Deep generative models, such as diffusion models, GANs, and IMLE, have shown impressive capability in tackling inverse problems. However, the validity of model-generated solutions w.r.t. the forward problem and the reliability of associated uncertainty estimates remain understudied. This study evaluates recent diffusion-based, GAN-based, and IMLE-based methods on three inverse problems, i.e., $16\times$ super-resolution, colourization, and image decompression. We assess the validity of these models' outputs as solutions to the inverse problems and conduct a thorough analysis of the reliability of the models' estimates of uncertainty over the solution. Overall, we find that the IMLE-based CHIMLE method outperforms other methods in terms of producing valid solutions and reliable uncertainty estimates.


title: Reducing Satellite Interference to Radio Telescopes Using Beacons

abstract: This paper proposes the transmission of beacon signals to alert potential interferers of an ongoing or impending passive sensing measurement. We focus on the interference from Low-Earth Orbiting (LEO) satellites to a radio-telescope. We compare the beacon approach with two versions of Radio Quiet Zones (RQZs): fixed quiet zones on the ground and in the sky, and dynamic quiet zones that vary across satellites. The beacon-assisted approach can potentially exploit channel reciprocity, which accounts for short-term channel variations between the satellite and radio telescope. System considerations associated with beacon design and potential schemes for beacon transmission are discussed. The probability of excessive Radio Frequency Interference (RFI) at the radio telescope (outage probability) and the fraction of active links in the satellite network are used as performance metrics. Numerical simulations compare the performance of the approaches considered, and show that the beacon approach enables more active satellite links relative to quiet zones for a given outage probability.


title: Anderson Accelerated Gauss-Newton-guided deep learning for nonlinear inverse problems with Application to Electrical Impedance Tomography

abstract: Physics-guided deep learning is an important prevalent research topic in scientific machine learning, which has tremendous potential in various complex applications including science and engineering. In these applications, data is expensive to acquire and high accuracy is required for making decisions. In this work, we introduce an efficient physics-guided deep learning framework for the variational modeling of nonlinear inverse problems, which is then applied to solve an electrical impedance tomography (EIT) inverse problem. The framework is achieved by unrolling the proposed Anderson accelerated Gauss-Newton (GNAA) algorithm into an end-to-end deep learning method. Firstly, we show the convergence of the GNAA algorithm in both cases: Anderson depth is equal to one and Anderson depth is greater than one. Then, we propose three types of strategies by combining the complementary strengths of GNAA and deep learning: GNAA of learned regularization (GNAA-LRNet), where the singular values of the regularization matrix are learned by a deep neural network; GNAA of learned proximity (GNAA-LPNet), where the regularization proximal operator is learned by using a deep neural network; GNAA of plug-and-play method (GNAA-PnPNet) where the regularization proximal operator is replaced by a pre-trained deep denoisers. Lastly, we present some numerical experiments to illustrate that the proposed approaches greatly improve the convergence rate and the quality of inverse solutions.


title: Data-driven Design of High Pressure Hydride Superconductors using DFT and Deep Learning

abstract: The observation of superconductivity in hydride-based materials under ultrahigh pressures (for example, H$_3$S and LaH$_{10}$) has fueled the interest in a more data-driven approach to discovering new high-pressure hydride superconductors. In this work, we performed density functional theory (DFT) calculations to predict the critical temperature ($T_c$) of over 900 hydride materials under a pressure range of (0 to 500) GPa, where we found 122 dynamically stable structures with a $T_c$ above MgB$_2$ (39 K). To accelerate screening, we trained a graph neural network (GNN) model to predict $T_c$ and demonstrated that a universal machine learned force-field can be used to relax hydride structures under arbitrary pressures, with significantly reduced cost. By combining DFT and GNNs, we can establish a more complete map of hydrides under pressure.


title: Excitations and phase ordering of the spin-stripe phase of a binary dipolar condensate

abstract: We consider the ground states, excitations and dynamics of a quasi-two-dimensional binary dipolar Bose-Einstein condensate. Our focus is on the transition to a spin-stripe ground state in which the translational invariance is spontaneously broken by a striped immiscible pattern of the alternating components. We develop a ground state phase diagram showing the parameter regime where the spin-stripe state occurs. Using Bogoliubov theory we calculate the excitation spectrum and structure factors. We identify a balanced regime where the system has a $\mathbb{Z}_2$ symmetry, and in the spin-stripe state this yields a nonsymmorphic symmetry. We consider the evolution of the system following a quench from the uniform to spin-stripe state, revealing novel ordering dynamics involving defects of the stripe order. Using an order parameter to characterize the orientational order of the stripes, we show that the phase ordering exhibits dynamic scaling.


title: Analysis of two-terminal perovskite/silicon tandem solar cells with differing texture structure, perovskite carrier lifetime and tunneling junction quality

abstract: Presented here is the optimization of a planar two-terminal perovskite/silicon tandem solar cell with a texture structure. The developed simulation model is fitted to published experimental results, and the importance of current matching in the two-terminal structure is discussed. With the texture structure optimized and considering current matching, the optimal texture structure improves $J_{sc}$ from 17.9~mA/cm$^2$ to 20.87~mA/cm$^2$ compared to the planar structure, as well as improving the power conversion efficiency from 25.8% to 35.9%. Furthermore, if the quality of the perovskite thin film and tunneling junction efficiency with a smaller voltage penalty can be improved, then the efficiency can be further improved to 38.13%. This indicates that this tandem solar cell still has much room for improvement.


title: DGCLUSTER: A Neural Framework for Attributed Graph Clustering via Modularity Maximization

abstract: Graph clustering is a fundamental and challenging task in the field of graph mining where the objective is to group the nodes into clusters taking into consideration the topology of the graph. It has several applications in diverse domains spanning social network analysis, recommender systems, computer vision, and bioinformatics. In this work, we propose a novel method, DGCluster, which primarily optimizes the modularity objective using graph neural networks and scales linearly with the graph size. Our method does not require the number of clusters to be specified as a part of the input and can also leverage the availability of auxiliary node level information. We extensively test DGCluster on several real-world datasets of varying sizes, across multiple popular cluster quality metrics. Our approach consistently outperforms the state-of-the-art methods, demonstrating significant performance gains in almost all settings.


title: Stand-Up Indulgent Gathering on Lines for Myopic Luminous Robots

abstract: We consider a strong variant of the crash fault-tolerant gathering problem called stand-up indulgent gathering (SUIG), by robots endowed with limited visibility sensors and lights on line-shaped networks. In this problem, a group of mobile robots must eventually gather at a single location, not known beforehand, regardless of the occurrence of crashes. Differently from previous work that considered unlimited visibility, we assume that robots can observe nodes only within a certain fixed distance (that is, they are myopic), and emit a visible color from a fixed set (that is, they are luminous), without multiplicity detection. We consider algorithms depending on two parameters related to the initial configuration: $M_{init}$, which denotes the number of nodes between two border nodes, and $O_{init}$, which denotes the number of nodes hosting robots. Then, a border node is a node hosting one or more robots that cannot see other robots on at least one side. Our main contribution is to prove that, if $M_{init}$ or $O_{init}$ is odd, SUIG can be solved in the fully synchronous model.


title: Stability of the numerical scheme for stochastic McKean-Vlasov equations

abstract: This paper studies the infinite-time stability of the numerical scheme for stochastic McKean-Vlasov equations (SMVEs) via stochastic particle method. The long-time propagation of chaos in mean-square sense is obtained, with which the almost sure propagation in infinite horizon is proved by exploiting the Chebyshev inequality and the Borel-Cantelli lemma. Then the mean-square and almost sure exponential stabilities of the Euler-Maruyama scheme associated with the corresponding interacting particle system are shown through an ingenious manipulation of empirical measure. Combining the assertions enables the numerical solutions to reproduce the stabilities of the original SMVEs. The examples are demonstrated to reveal the importance of this study.


title: Performance rating in chess, tennis, and other contexts

abstract: In this note, I introduce Estimated Performance Rating (PR$^e$), a novel system for evaluating player performance in sports and games. PR$^e$ addresses a key limitation of the Tournament Performance Rating (TPR) system, which is undefined for zero or perfect scores in a series of games. PR$^e$ is defined as the rating that solves an optimization problem related to scoring probability, making it applicable for any performance level. The main theorem establishes that the PR$^e$ of a player is equivalent to the TPR whenever the latter is defined. I then apply this system to historically significant win-streaks in association football, tennis, and chess. Beyond sports, PR$^e$ has broad applicability in domains where Elo ratings are used, from college rankings to the evaluation of large language models.


title: On the laminar solutions and stability of accelerating and decelerating channel flows

abstract: We study the effect of acceleration and deceleration on the stability of channel flows. To do so, we derive an exact solution for laminar profiles of channel flows with arbitrary, time-varying wall motion and pressure gradient. This solution then allows us to investigate the stability of any unsteady channel flow. In particular, we investigate the nonnormal growth of perturbations in flows with exponentially decaying acceleration and deceleration, with comparisons to growth in a constant flow (i.e., the time-invariant simple shear or parabolic profile). We apply this acceleration and deceleration through the velocity of the walls and through the flow rate. For accelerating flows, disturbances never grow larger than disturbances in a constant flow, while decelerating flows show massive amplification of disturbances -- at a Reynolds number of 800, disturbances in the decelerating flow grow $\mathscr{O}(10^4)$ times larger than disturbances grow in a constant flow. This amplification increases as we raise the rate of deceleration and the Reynolds number. We find that this amplification arises due to a transition from spanwise perturbations leading to the largest amplification, to streamwise perturbations leading to the largest amplification that only occurs in the decelerating flow. By evolving the optimal perturbations through the linearized equations of motion, we reveal that the decelerating case achieves this massive amplification through a down-gradient Reynolds stress mechanism, which accelerating and constant flows cannot maintain. Finally, we end the paper by validating that these perturbations exhibit the same growth behaviors in direct numerical simulations.


title: Black Holes and Non-perturbative Gravitational Waves in $f(R)$ Gravity

abstract: Exact solutions of spherically symmetric black hole and gravitational wave are explored in $f(R)$ gravity in arbitrary dimension. We find two exact solutions for the radiation and absorption of null dust. In the framework of general relativity, the Birkhoff theorem strictly forbids the existence of spherical gravitational waves in vacuum space. We find spherical non-perturbative gravitational waves, which are shear-free, twist-free, but expanding.


title: Federated Learning with Extremely Noisy Clients via Negative Distillation

abstract: Federated learning (FL) has shown remarkable success in cooperatively training deep models, while typically struggling with noisy labels. Advanced works propose to tackle label noise by a re-weighting strategy with a strong assumption, i.e., mild label noise. However, it may be violated in many real-world FL scenarios because of highly contaminated clients, resulting in extreme noise ratios, e.g., $>$90%. To tackle extremely noisy clients, we study the robustness of the re-weighting strategy, showing a pessimistic conclusion: minimizing the weight of clients trained over noisy data outperforms re-weighting strategies. To leverage models trained on noisy clients, we propose a novel approach, called negative distillation (FedNed). FedNed first identifies noisy clients and employs rather than discards the noisy clients in a knowledge distillation manner. In particular, clients identified as noisy ones are required to train models using noisy labels and pseudo-labels obtained by global models. The model trained on noisy labels serves as a `bad teacher' in knowledge distillation, aiming to decrease the risk of providing incorrect information. Meanwhile, the model trained on pseudo-labels is involved in model aggregation if not identified as a noisy client. Consequently, through pseudo-labeling, FedNed gradually increases the trustworthiness of models trained on noisy clients, while leveraging all clients for model aggregation through negative distillation. To verify the efficacy of FedNed, we conduct extensive experiments under various settings, demonstrating that FedNed can consistently outperform baselines and achieve state-of-the-art performance. Our code is available at https://github.com/linChen99/FedNed.


title: Merging mechanical bound states in the continuum in high-aspect-ratio phononic crystal gratings

abstract: Mechanical bound states in the continuum (BICs) present an alternative avenue for developing high-frequency, high-Q mechanical resonators, distinct from the conventional band structure engineering method. While symmetry-protected mechanical BICs have been realized in phononic crystals, the observation of accidental mechanical BICs -- whose existence is independent of mode symmetry and tunable by structural parameters -- has remained elusive. This challenge is primarily attributed to the additional radiation channel introduced by the longitudinal component of elastic waves. Here, we employ a coupled wave theory to predict and experimentally demonstrate mechanical accidental BICs within a high-aspect-ratio gallium arsenide phononic crystal grating. We observe the merging process of accidental BICs with symmetry-protected BICs, resulting in reduced acoustic radiation losses compared to isolated BICs. This finding opens up new possibilities for phonon trapping using BIC-based systems, with potential applications in sensing, transduction, and quantum measurements.


title: Optimizing Distributed Training on Frontier for Large Language Models

abstract: Large language models (LLMs) have demonstrated remarkable success as foundational models, benefiting various downstream applications through fine-tuning. Recent studies on loss scaling have demonstrated the superior performance of larger LLMs compared to their smaller counterparts. Nevertheless, training LLMs with billions of parameters poses significant challenges and requires considerable computational resources. For example, training a one trillion parameter GPT-style model on 20 trillion tokens requires a staggering 120 million exaflops of computation. This research explores efficient distributed training strategies to extract this computation from Frontier, the world's first exascale supercomputer dedicated to open science. We enable and investigate various model and data parallel training techniques, such as tensor parallelism, pipeline parallelism, and sharded data parallelism, to facilitate training a trillion-parameter model on Frontier. We empirically assess these techniques and their associated parameters to determine their impact on memory footprint, communication latency, and GPU's computational efficiency. We analyze the complex interplay among these techniques and find a strategy to combine them to achieve high throughput through hyperparameter tuning. We have identified efficient strategies for training large LLMs of varying sizes through empirical analysis and hyperparameter tuning. For 22 Billion, 175 Billion, and 1 Trillion parameters, we achieved GPU throughputs of $38.38\%$, $36.14\%$, and $31.96\%$, respectively. For the training of the 175 Billion parameter model and the 1 Trillion parameter model, we achieved $100\%$ weak scaling efficiency on 1024 and 3072 MI250X GPUs, respectively. We also achieved strong scaling efficiencies of $89\%$ and $87\%$ for these two models.


title: Dynamical Approach to Realize Room-Temperature Superconductivity in LaH$_{10}$

abstract: Metallic hydrogen and hydride materials stand as promising avenues to achieve room-temperature superconductivity. Characterized by their high phonon frequencies and moderate coupling strengths, several high-pressure hydrides were theoretically predicted to exhibit transition temperatures ($T_c$) exceeding 250\,K, a claim further substantiated by experimental evidence. In an effort to push $T_c$ beyond room temperature, we introduce a dynamical method that involves stimulating hydrides with mid-infrared lasers. Employing Floquet first-principles simulations, we observe that in a nonequilibrium state induced by light, both the electronic density of states and the coupling to high-energy phonons see notable enhancements. These simultaneous improvements collectively result in an estimated 20\%-30\% rise in $T_c$ in practical pump conditions. Our theoretical investigation, therefore, offers a novel strategy to potentially raise the $T_c$ of hydrides above room temperature.


title: Measurement of the Double Star System WDS 03286+2523 BRT 133 with a Web Telescope

abstract: WDS 03286+2523 BRT 133, is a double-star system that has been under observation since 1896. In this study, we present new measurements of the position angle and separation of the system, utilizing data obtained from a web telescope with a Charged Couple Device (CCD) camera, Gaia EDR3, and historical records. We determined that the position angle and separation are 222.4{\deg} and 5.35", respectively, indicating a slight increase from the previous values of 222{\deg} and 5.34" measured in 2004. We also employed the parallax and the ratio of proper motion metric (rPM) values of the system to assess its binarity. This analysis showed that the system may be gravitationally bound and with a long orbital period.


title: Gradient flows for empirical Bayes in high-dimensional linear models

abstract: Empirical Bayes provides a powerful approach to learning and adapting to latent structure in data. Theory and algorithms for empirical Bayes have a rich literature for sequence models, but are less understood in settings where latent variables and data interact through more complex designs. In this work, we study empirical Bayes estimation of an i.i.d. prior in Bayesian linear models, via the nonparametric maximum likelihood estimator (NPMLE). We introduce and study a system of gradient flow equations for optimizing the marginal log-likelihood, jointly over the prior and posterior measures in its Gibbs variational representation using a smoothed reparametrization of the regression coefficients. A diffusion-based implementation yields a Langevin dynamics MCEM algorithm, where the prior law evolves continuously over time to optimize a sequence-model log-likelihood defined by the coordinates of the current Langevin iterate. We show consistency of the NPMLE as $n, p \rightarrow \infty$ under mild conditions, including settings of random sub-Gaussian designs when $n \asymp p$. In high noise, we prove a uniform log-Sobolev inequality for the mixing of Langevin dynamics, for possibly misspecified priors and non-log-concave posteriors. We then establish polynomial-time convergence of the joint gradient flow to a near-NPMLE if the marginal negative log-likelihood is convex in a sub-level set of the initialization.


title: The spectra of Laplace operators on covering simplicial complexes

abstract: In this paper, by the representation theory of symmetric group, we give a decomposition of the Laplace operator (in matrix form) of a covering simplicial complex into the direct sum of some matrices, including the Laplace operator of the underlying simplicial complex. So, the spectrum of a covering simplicial complex can be expressed into a union of the spectrum of the underlying simplicial complex and the spectra of some other matrices, which implies a result of Horak and Jost. In particular, we show that the spectrum of a $2$-fold covering simplicial complex is the union the that of the underlying simplicial complex and that of an incidence-signed simplicial complex, which is an analog of Bilu and Linial's result on graphs. Finally we show that the dimension of the cohomology group of a covering simplicial complex is greater than or equal to that of the underlying simplicial complex.


title: Semiparametric Copula Estimation for Spatially Correlated Multivariate Mixed Outcomes: Analyzing Visual Sightings of Fin Whales from Line Transect Survey

abstract: Multivariate data having both continuous and discrete variables is known as mixed outcomes and has widely appeared in a variety of fields such as ecology, epidemiology, and climatology. In order to understand the probability structure of multivariate data, the estimation of the dependence structure among mixed outcomes is very important. However, when location information is equipped with multivariate data, the spatial correlation should be adequately taken into account; otherwise, the estimation of the dependence structure would be severely biased. To solve this issue, we propose a semiparametric Bayesian inference for the dependence structure among mixed outcomes while eliminating spatial correlation. To this end, we consider a hierarchical spatial model based on the rank likelihood and a latent multivariate Gaussian process. We develop an efficient algorithm for computing the posterior using the Markov Chain Monte Carlo. We also provide a scalable implementation of the model using the nearest-neighbor Gaussian process under large spatial datasets. We conduct a simulation study to validate our proposed procedure and demonstrate that the procedure successfully accounts for spatial correlation and correctly infers the dependence structure among outcomes. Furthermore, the procedure is applied to a real example collected during an international synoptic krill survey in the Scotia Sea of the Antarctic Peninsula, which includes sighting data of fin whales (Balaenoptera physalus), and the relevant oceanographic data.


title: On the rigidity of uniformly rotating vortex patch near the Rankine vortex

abstract: In this paper, we study the uniformly rotating vortex patch solutions for the 2D incompressible Euler equations. Specifically, we prove that if the patch solution is close to the Rankine vortex in a certain weak topology, it is either the Kirchhoff ellipses or the Rankine vortex.


title: Investigating the impact of atomic data uncertainties on measured physical parameters of the Perseus galaxy cluster

abstract: Accurate atomic data and plasma models are essential for interpreting the upcoming high-quality spectra from missions like XRISM and Athena. Estimating physical quantities, like temperature, abundance, turbulence, and resonance scattering factor, is highly dependent on the underlying atomic data. We use the AtomDB tool variableapec to estimate the impact of atomic data uncertainties in Einstein A coefficients, collisional rate coefficient, ionization and recombination rates in H-, He- and Li-like iron in modeling the spectrum of Perseus observed by Hitomi. The best-fit temperature, abundance, resonance scattering factor, and turbulence including atomic data uncertainties, varied approximately 17%, 35%, 30%, and 3%, respectively, from the best-fit temperature, abundance, resonance scattering factor, and turbulence estimated without atomic data uncertainties. This indicates that, approximately 32%, 35%, and 25% of the best-fit temperatures, abundances, and resonance scattering factors, including uncertainties lie outside the 3$\sigma$ error regions of their corresponding best-fit values computed with zero atomic data error. Expanding the energy range to 1.8-20.0 keV shows less variability, with 26% of the abundances and 22% of the resonance scattering factors lying outside the 3$\sigma$ error of the best-fit values. We also studied correlations between physical parameters and atomic rate uncertainties to identify key atomic quantities requiring precise lab measurements. We report negative correlations between best-fit temperature and z (1s.2s $^{3}\rm S_{1}\rightarrow 1s^{2}$) collisional rate coefficient, abundance and y (1s.2p $^{3}\rm P_{1}\rightarrow 1s^{2}$) collisional rate coefficient, abundance and z collisional rate coefficient, and positive correlation between resonance scattering factor and w (1s.2p $^{1}\rm P_{1}\rightarrow 1s^{2}$) collisional rate coefficient.


title: Response Enhanced Semi-supervised Dialogue Query Generation

abstract: Leveraging vast and continually updated knowledge from the Internet has been considered an important ability for a dialogue system. Therefore, the dialogue query generation task is proposed for generating search queries from dialogue histories, which will be submitted to a search engine for retrieving relevant websites on the Internet. In this regard, previous efforts were devoted to collecting conversations with annotated queries and training a query producer (QP) via standard supervised learning. However, these studies still face the challenges of data scarcity and domain adaptation. To address these issues, in this paper, we propose a semi-supervised learning framework -- SemiDQG, to improve model performance with unlabeled conversations. Based on the observation that the search query is typically related to the topic of dialogue response, we train a response-augmented query producer (RA) to provide rich and effective training signals for QP. We first apply a similarity-based query selection strategy to select high-quality RA-generated pseudo queries, which are used to construct pseudo instances for training QP and RA. Then, we adopt the REINFORCE algorithm to further enhance QP, with RA-provided rewards as fine-grained training signals. Experimental results and in-depth analysis of three benchmarks show the effectiveness of our framework in cross-domain and low-resource scenarios. Particularly, SemiDQG significantly surpasses ChatGPT and competitive baselines. Our code is available at \url{https://github.com/DeepLearnXMU/SemiDQG}.


title: Electromagnetically-induced transparency assists the Raman gradient echo memory at moderate detuning, dependent on gradient order

abstract: Optical quantum memories are essential for quantum communications and photonic quantum technologies. Ensemble optical memories based on 3-level interactions are a popular basis for implementing these memories. All such memories, however, suffer from loss due to scattering. In off-resonant 3-level interactions, such as the Raman gradient echo memory (GEM), scattering loss can be reduced by a large detuning from the intermediate state. In this work, we show how electromagnetically induced transparency adjacent to the Raman absorption line plays a crucial role in reducing scattering loss, so that maximum efficiency is in fact achieved at a moderate detuning. Furthermore, the effectiveness of the transparency, and therefore the efficiency of GEM, depends on the order in which gradients are applied to store and recall the light. We provide a theoretical analysis and show experimentally how the efficiency depends on gradient order and detuning.


title: Learning Performance Maximizing Ensembles with Explainability Guarantees

abstract: In this paper we propose a method for the optimal allocation of observations between an intrinsically explainable glass box model and a black box model. An optimal allocation being defined as one which, for any given explainability level (i.e. the proportion of observations for which the explainable model is the prediction function), maximizes the performance of the ensemble on the underlying task, and maximizes performance of the explainable model on the observations allocated to it, subject to the maximal ensemble performance condition. The proposed method is shown to produce such explainability optimal allocations on a benchmark suite of tabular datasets across a variety of explainable and black box model types. These learned allocations are found to consistently maintain ensemble performance at very high explainability levels (explaining $74\%$ of observations on average), and in some cases even outperforming both the component explainable and black box models while improving explainability.


title: BloomVQA: Assessing Hierarchical Multi-modal Comprehension

abstract: We propose a novel VQA dataset, BloomVQA, to facilitate comprehensive evaluation of large vision-language models on comprehension tasks. Unlike current benchmarks that often focus on fact-based memorization and simple reasoning tasks without theoretical grounding, we collect multiple-choice samples based on picture stories that reflect different levels of comprehension, as laid out in Bloom's Taxonomy, a classic framework for learning assessment widely adopted in education research. Our data maps to a novel hierarchical graph representation which enables automatic data augmentation and novel measures characterizing model consistency. We perform graded evaluation and reliability analysis on recent multi-modal models. In comparison to low-level tasks, we observe decreased performance on tasks requiring advanced comprehension and cognitive skills with up to 38.0\% drop in VQA accuracy. In comparison to earlier models, GPT-4V demonstrates improved accuracy over all comprehension levels and shows a tendency of bypassing visual inputs especially for higher-level tasks. Current models also show consistency patterns misaligned with human comprehension in various scenarios, demonstrating the need for improvement based on theoretically-grounded criteria.


title: DoDo-Code: a Deep Levenshtein Distance Embedding-based Code for IDS Channel and DNA Storage

abstract: Recently, DNA storage has emerged as a promising data storage solution, offering significant advantages in storage density, maintenance cost efficiency, and parallel replication capability. Mathematically, the DNA storage pipeline can be viewed as an insertion, deletion, and substitution (IDS) channel. Because of the mathematical terra incognita of the Levenshtein distance, designing an IDS-correcting code is still a challenge. In this paper, we propose an innovative approach that utilizes deep Levenshtein distance embedding to bypass these mathematical challenges. By representing the Levenshtein distance between two sequences as a conventional distance between their corresponding embedding vectors, the inherent structural property of Levenshtein distance is revealed in the friendly embedding space. Leveraging this embedding space, we introduce the DoDo-Code, an IDS-correcting code that incorporates deep embedding of Levenshtein distance, deep embedding-based codeword search, and deep embedding-based segment correcting. To address the requirements of DNA storage, we also present a preliminary algorithm for long sequence decoding. As far as we know, the DoDo-Code is the first IDS-correcting code designed using plausible deep learning methodologies, potentially paving the way for a new direction in error-correcting code research. It is also the first IDS code that exhibits characteristics of being `optimal' in terms of redundancy, significantly outperforming the mainstream IDS-correcting codes of the Varshamov-Tenengolts code family in code rate.


title: Polarized Neutron Diffraction Study on UPt$_{2}$Si$_{2}$

abstract: We investigated the magnetic structure of the antiferromagnetic (AFM) ordered state ($T_{\rm N} \sim$ 34 K) in tetragonal UPt$_{2}$Si$_{2}$ using polarized and unpolarized neutron diffraction. Previous neutron scattering studies reported that this system possesses a simple AFM structure with a propagation vector, $Q = 0$, and the ordered magnetic moments aligned along the $c$-axis. By contrast, our latest resonant X-ray scattering (RXS) experiments have revealed that the magnetic structure is modulated by the charge-density-wave (CDW) order, which emerges in one of the two Pt atomic layers in the unit cell below $\sim$ 320 K. The modulation is characterized by a transverse wave in the $c$-plane, with the propagation vector of the CDW order, $q_{\rm CDW } =$ ($\sim$0.42, 0, 0). In the present study using neutron scattering, we observed that the superlattice reflections specified by $q_{\rm CDW }$ develop below $T_{\rm N}$, in addition to the magnetic reflections with $Q = 0$, thereby further confirming the presence of modulation in the AFM structure of this system. From detailed analyses, we revealed that the amplitude of the transverse-wave magnetic modulation to be 0.72(2) $\mu_{\rm B}$/U, which is a piece of quantitative information that could not be obtained through the RXS experiments. This implies that the CDW drives the ordered magnetic moments to be tilted up to 20$^\circ$ in the AFM state. The observations strongly suggest that the magnetism of UPt$_{2}$Si$_{2}$ is heavily influenced by the hybridization effects between 5f electrons of U and 5d electrons of Pt.


title: Measurements of $\Sigma$ electromagnetic form factors in the time-like region using the untagged initial-state radiation technique

abstract: The process $e^{+}e^{-}\to\Sigma^{+}\bar{\Sigma}^{-}$ is studied from threshold up to 3.04 GeV/$c^2$ via the initial-state radiation technique using data with an integrated luminosity of 12.0 fb$^{-1}$, collected at center-of-mass energies between 3.773 and 4.258 GeV with the BESIII detector at the BEPCII collider. The pair production cross sections and the effective form factors of $\Sigma$ are measured in eleven $\Sigma^{+}\bar{\Sigma}^{-}$ invariant mass intervals from threshold to 3.04 GeV/$c^2$. The results are consistent with the previous results from Belle and BESIII. Furthermore, the branching fractions of the decays $J/\psi\to\Sigma^{+}\bar{\Sigma}^{-}$ and $\psi(3686)\to\Sigma^{+}\bar{\Sigma}^{-}$ are determined and the obtained results are consistent with the previous results of BESIII.


title: AdvST: Revisiting Data Augmentations for Single Domain Generalization

abstract: Single domain generalization (SDG) aims to train a robust model against unknown target domain shifts using data from a single source domain. Data augmentation has been proven an effective approach to SDG. However, the utility of standard augmentations, such as translate, or invert, has not been fully exploited in SDG; practically, these augmentations are used as a part of a data preprocessing procedure. Although it is intuitive to use many such augmentations to boost the robustness of a model to out-of-distribution domain shifts, we lack a principled approach to harvest the benefit brought from multiple these augmentations. Here, we conceptualize standard data augmentations with learnable parameters as semantics transformations that can manipulate certain semantics of a sample, such as the geometry or color of an image. Then, we propose Adversarial learning with Semantics Transformations (AdvST) that augments the source domain data with semantics transformations and learns a robust model with the augmented data. We theoretically show that AdvST essentially optimizes a distributionally robust optimization objective defined on a set of semantics distributions induced by the parameters of semantics transformations. We demonstrate that AdvST can produce samples that expand the coverage on target domain data. Compared with the state-of-the-art methods, AdvST, despite being a simple method, is surprisingly competitive and achieves the best average SDG performance on the Digits, PACS, and DomainNet datasets. Our code is available at https://github.com/gtzheng/AdvST.


title: Cross-Modal Reasoning with Event Correlation for Video Question Answering

abstract: Video Question Answering (VideoQA) is a very attractive and challenging research direction aiming to understand complex semantics of heterogeneous data from two domains, i.e., the spatio-temporal video content and the word sequence in question. Although various attention mechanisms have been utilized to manage contextualized representations by modeling intra- and inter-modal relationships of the two modalities, one limitation of the predominant VideoQA methods is the lack of reasoning with event correlation, that is, sensing and analyzing relationships among abundant and informative events contained in the video. In this paper, we introduce the dense caption modality as a new auxiliary and distill event-correlated information from it to infer the correct answer. To this end, we propose a novel end-to-end trainable model, Event-Correlated Graph Neural Networks (EC-GNNs), to perform cross-modal reasoning over information from the three modalities (i.e., caption, video, and question). Besides the exploitation of a brand new modality, we employ cross-modal reasoning modules for explicitly modeling inter-modal relationships and aggregating relevant information across different modalities, and we propose a question-guided self-adaptive multi-modal fusion module to collect the question-oriented and event-correlated evidence through multi-step reasoning. We evaluate our model on two widely-used benchmark datasets and conduct an ablation study to justify the effectiveness of each proposed component.


title: Fine-Grained Knowledge Selection and Restoration for Non-Exemplar Class Incremental Learning

abstract: Non-exemplar class incremental learning aims to learn both the new and old tasks without accessing any training data from the past. This strict restriction enlarges the difficulty of alleviating catastrophic forgetting since all techniques can only be applied to current task data. Considering this challenge, we propose a novel framework of fine-grained knowledge selection and restoration. The conventional knowledge distillation-based methods place too strict constraints on the network parameters and features to prevent forgetting, which limits the training of new tasks. To loose this constraint, we proposed a novel fine-grained selective patch-level distillation to adaptively balance plasticity and stability. Some task-agnostic patches can be used to preserve the decision boundary of the old task. While some patches containing the important foreground are favorable for learning the new task. Moreover, we employ a task-agnostic mechanism to generate more realistic prototypes of old tasks with the current task sample for reducing classifier bias for fine-grained knowledge restoration. Extensive experiments on CIFAR100, TinyImageNet and ImageNet-Subset demonstrate the effectiveness of our method. Code is available at https://github.com/scok30/vit-cil.


title: Multi-Clue Reasoning with Memory Augmentation for Knowledge-based Visual Question Answering

abstract: Visual Question Answering (VQA) has emerged as one of the most challenging tasks in artificial intelligence due to its multi-modal nature. However, most existing VQA methods are incapable of handling Knowledge-based Visual Question Answering (KB-VQA), which requires external knowledge beyond visible contents to answer questions about a given image. To address this issue, we propose a novel framework that endows the model with capabilities of answering more general questions, and achieves a better exploitation of external knowledge through generating Multiple Clues for Reasoning with Memory Neural Networks (MCR-MemNN). Specifically, a well-defined detector is adopted to predict image-question related relation phrases, each of which delivers two complementary clues to retrieve the supporting facts from external knowledge base (KB), which are further encoded into a continuous embedding space using a content-addressable memory. Afterwards, mutual interactions between visual-semantic representation and the supporting facts stored in memory are captured to distill the most relevant information in three modalities (i.e., image, question, and KB). Finally, the optimal answer is predicted by choosing the supporting fact with the highest score. We conduct extensive experiments on two widely-used benchmarks. The experimental results well justify the effectiveness of MCR-MemNN, as well as its superiority over other KB-VQA methods.


title: Progressive Poisoned Data Isolation for Training-time Backdoor Defense

abstract: Deep Neural Networks (DNN) are susceptible to backdoor attacks where malicious attackers manipulate the model's predictions via data poisoning. It is hence imperative to develop a strategy for training a clean model using a potentially poisoned dataset. Previous training-time defense mechanisms typically employ an one-time isolation process, often leading to suboptimal isolation outcomes. In this study, we present a novel and efficacious defense method, termed Progressive Isolation of Poisoned Data (PIPD), that progressively isolates poisoned data to enhance the isolation accuracy and mitigate the risk of benign samples being misclassified as poisoned ones. Once the poisoned portion of the dataset has been identified, we introduce a selective training process to train a clean model. Through the implementation of these techniques, we ensure that the trained model manifests a significantly diminished attack success rate against the poisoned data. Extensive experiments on multiple benchmark datasets and DNN models, assessed against nine state-of-the-art backdoor attacks, demonstrate the superior performance of our PIPD method for backdoor defense. For instance, our PIPD achieves an average True Positive Rate (TPR) of 99.95% and an average False Positive Rate (FPR) of 0.06% for diverse attacks over CIFAR-10 dataset, markedly surpassing the performance of state-of-the-art methods.


title: A Criterion for Unentanglement of Quantum States

abstract: The concept of entanglement is at the core of the theory of quantum information. In this paper a criterion for unentanglement of quantum states is proposed and proved. This criterion is natural, practical and easy to check.


title: Reducing Shape-Radiance Ambiguity in Radiance Fields with a Closed-Form Color Estimation Method

abstract: Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss in an end-to-end training manner, NeRF inherently suffers from the shape-radiance ambiguity problem, i.e., it can perfectly fit training views but does not guarantee decoupling the two fields correctly. To deal with this issue, existing works have incorporated prior knowledge to provide an independent supervision signal for the density field, including total variation loss, sparsity loss, distortion loss, etc. These losses are based on general assumptions about the density field, e.g., it should be smooth, sparse, or compact, which are not adaptive to a specific scene. In this paper, we propose a more adaptive method to reduce the shape-radiance ambiguity. The key is a rendering method that is only based on the density field. Specifically, we first estimate the color field based on the density field and posed images in a closed form. Then NeRF's rendering process can proceed. We address the problems in estimating the color field, including occlusion and non-uniformly distributed views. Afterward, it is applied to regularize NeRF's density field. As our regularization is guided by photometric loss, it is more adaptive compared to existing ones. Experimental results show that our method improves the density field of NeRF both qualitatively and quantitatively. Our code is available at https://github.com/qihangGH/Closed-form-color-field.


title: Black Content Creators' Responses and Resistance Strategies on TikTok

abstract: Social media wields a profound influence on social and economic dynamics worldwide, people on social media began to forge a livelihood through their online presence through creative labor. This surge in social media Content Creators significantly shaped the trends and cultural landscape of the internet. While many of the social media trends we observe today can be attributed to the creative contributions of Black Content Creators, digital platforms routinely marginalize and undermine these creators through algorithmic recommendation systems that produce systemic bias against Black and Brown people. To address this problem, we conducted a content analysis to assess how algorithms specifically illicit harassment, interact, and unfairly target Black Content Creators.


title: Lookahead: An Inference Acceleration Framework for Large Language Model with Lossless Generation Accuracy

abstract: As Large Language Models (LLMs) have made significant advancements across various tasks, such as question answering, translation, text summarization, and dialogue systems, the need for accuracy in information becomes crucial, especially for serious financial products serving billions of users like Alipay. However, for a real-world product serving millions of users, the inference speed of LLMs becomes a critical factor compared to a mere experimental model. Hence, this paper presents a generic framework for accelerating the inference process, resulting in a substantial increase in speed and cost reduction for our LLM-based scenarios, with lossless generation accuracy. In the traditional inference process, each token is generated sequentially by the LLM, leading to a time consumption proportional to the number of generated tokens. To enhance this process, our framework, named \textit{lookahead}, introduces a \textit{multi-branch} strategy. Instead of generating a single token at a time, we propose a Trie-based retrieval and verification mechanism to be able to accept several tokens at a forward step. Our strategy offers two distinct advantages: (1) it guarantees absolute correctness of the output, avoiding any approximation algorithms, and (2) the worst-case performance of our approach is equivalent to the conventional process. We conduct extensive experiments to demonstrate the significant improvements achieved by applying our inference acceleration framework. Our framework is widely deployed in Alipay since April 2023, and obtain remarkable 2.66x to 6.26x speedup. Our code is available at https://github.com/alipay/PainlessInferenceAcceleration.