title: Diversifying Human Pose in Synthetic Data for Aerial-view Human Detection

abstract: We present a framework for diversifying human poses in a synthetic dataset for aerial-view human detection. Our method firstly constructs a set of novel poses using a pose generator and then alters images in the existing synthetic dataset to assume the novel poses while maintaining the original style using an image translator. Since images corresponding to the novel poses are not available in training, the image translator is trained to be applicable only when the input and target poses are similar, thus training does not require the novel poses and their corresponding images. Next, we select a sequence of target novel poses from the novel pose set, using Dijkstra's algorithm to ensure that poses closer to each other are located adjacently in the sequence. Finally, we repeatedly apply the image translator to each target pose in sequence to produce a group of novel pose images representing a variety of different limited body movements from the source pose. Experiments demonstrate that, regardless of how the synthetic data is used for training or the data size, leveraging the pose-diversified synthetic dataset in training generally presents remarkably better accuracy than using the original synthetic dataset on three aerial-view human detection benchmarks (VisDrone, Okutama-Action, and ICG) in the few-shot regime.


title: Exploring the physical properties of the $\gamma$ Dor binary star RX Dra with photometry and asteroseismology

abstract: We model the TESS light curve of the binary system RX Dra, and also first calculate a lot of theoretical models to fit the g-mode frequencies previously detected from the TESS series of this system. The mass ratio is determined to be $q$=0.9026$^{+0.0032}_{-0.0032}$. We newly found that there are 16 frequencies (F1-F7, F11-F20) identified as dipole g-modes, two frequencies (F21, F22) identified as quadrupole g-modes, and another two frequencies (F23, F24) identified as g-sextupole modes, based on these model fits. The primary star is newly determined to be a $\gamma$ Dor pulsator in the main-sequence stage with a rotation period of about 5.7$^{+0.7}_{-0.2}$ days, rotating slower than the orbital motion. The fundamental parameters of two components are firstly estimated as follows: $M_1$=1.53$^{+0.00}_{-0.17}$ M $_{\odot}$, $M_2$= 1.38$^{+0.18}_{-0.00}$ M $_{\odot}$, $T_1$=7240$^{+490}_{-44}$ K, $T_2$=6747$^{+201}_{-221}$ K, $R_1$=1.8288$^{+0.0260}_{-0.0959}$ R $_{\odot}$, $R_2$= 1.3075$^{+0.0450}_{-0.2543}$ R $_{\odot}$, $L_1$=8.2830$^{+1.8015}_{-0.6036}$ L $_{\odot}$ and $L_2$= 3.4145$^{+0.1320}_{-0.1843}$ L $_{\odot}$. Our results show that the secondary star is in the solar-like pulsator region of the H-R diagram, indicating that it could be a pulsating star of this type. Finally, the radius of the convective core of the primary star is estimated to be about 0.1403$^{+0.0206}_{-0.0000}$ R$_{\odot}$.


title: A Unified Theory of Stochastic Proximal Point Methods without Smoothness

abstract: This paper presents a comprehensive analysis of a broad range of variations of the stochastic proximal point method (SPPM). Proximal point methods have attracted considerable interest owing to their numerical stability and robustness against imperfect tuning, a trait not shared by the dominant stochastic gradient descent (SGD) algorithm. A framework of assumptions that we introduce encompasses methods employing techniques such as variance reduction and arbitrary sampling. A cornerstone of our general theoretical approach is a parametric assumption on the iterates, correction and control vectors. We establish a single theorem that ensures linear convergence under this assumption and the $\mu$-strong convexity of the loss function, and without the need to invoke smoothness. This integral theorem reinstates best known complexity and convergence guarantees for several existing methods which demonstrates the robustness of our approach. We expand our study by developing three new variants of SPPM, and through numerical experiments we elucidate various properties inherent to them.


title: Can Implicit Bias Imply Adversarial Robustness?

abstract: The implicit bias of gradient-based training algorithms has been considered mostly beneficial as it leads to trained networks that often generalize well. However, Frei et al. (2023) show that such implicit bias can harm adversarial robustness. Specifically, they show that if the data consists of clusters with small inter-cluster correlation, a shallow (two-layer) ReLU network trained by gradient flow generalizes well, but it is not robust to adversarial attacks of small radius. Moreover, this phenomenon occurs despite the existence of a much more robust classifier that can be explicitly constructed from a shallow network. In this paper, we extend recent analyses of neuron alignment to show that a shallow network with a polynomial ReLU activation (pReLU) trained by gradient flow not only generalizes well but is also robust to adversarial attacks. Our results highlight the importance of the interplay between data structure and architecture design in the implicit bias and robustness of trained networks.


title: Transformers represent belief state geometry in their residual stream

abstract: What computational structure are we building into large language models when we train them on next-token prediction? Here, we present evidence that this structure is given by the meta-dynamics of belief updating over hidden states of the data-generating process. Leveraging the theory of optimal prediction, we anticipate and then find that belief states are linearly represented in the residual stream of transformers, even in cases where the predicted belief state geometry has highly nontrivial fractal structure. We investigate cases where the belief state geometry is represented in the final residual stream or distributed across the residual streams of multiple layers, providing a framework to explain these observations. Furthermore we demonstrate that the inferred belief states contain information about the entire future, beyond the local next-token prediction that the transformers are explicitly trained on. Our work provides a framework connecting the structure of training data to the computational structure and representations that transformers use to carry out their behavior.


title: Weighing protoplanetary discs with kinematics: physical model, method and benchmark

abstract: The mass of protoplanetary discs sets the amount of material available for planet formation, determines the level of coupling between gas and dust, and possibly sets gravitational instabilities. Measuring mass of discs is challenging, since it is not possible to directly detect H$_2$, and CO-based estimates remain poorly constrained. An alternative method that does not rely on tracers-to-H$_2$ ratios has recently been proposed to dynamically measure the disc mass altogether with the star mass and the disc critical radius by looking at deviations from Keplerian rotation induced by the self-gravity of the disc. So far, this method has been applied to weigh three protoplanetary discs: Elias 2-27, IM Lup and GM Aurigae. We provide here a numerical benchmark of the method by simulating isothermal self-gravitating discs with a range of masses from 0.01 to $0.2 \,M_{\odot}$ with the phantom code and post-process them with radiative transfer (mcfost) to obtain synthetic observations. We find that dynamical weighing allows to retrieve the expected value of disc masses as long as the disc-to-star mass ratio is larger than $M_d/M_\star=0.05$. The estimated uncertainty for the disc mass measurement is $\sim 25\%$.


title: Analytic Extended Dynamic Mode Decomposition

abstract: We aim at developing an EDMD-type algorithm that captures the spectrum of the Koopman operator defined on a reproducing kernel Hilbert space of analytic functions. Our method relies on an orthogonal projection on polynomial subspaces, which is equivalent to Taylor approximation in a data-driven setting. In the case of dynamics with a hyperbolic equilibrium, the method demonstrates excellent performance to capture the lattice structured Koopman spectrum based on the eigenvalues of the linearized system at the equilibrium. Moreover, it yields the Taylor approximation of associated principal eigenfunctions. Since the method preserves the triangular structure of the operator, it does not suffer from spectral pollution and, moreover, arbitrary accuracy on the spectrum can be reached with a fixed finite dimension of the approximation.


title: Taub-NUT Instanton as the Self-dual Analog of Kerr

abstract: It was recently conjectured that a certain vacuum Kerr-Schild spacetime, which may be regarded as a self-dual analog of the Kerr metric, is equivalent to the self-dual Taub-NUT instanton. We confirm this conjecture by applying the Cartan-Karlhede algorithm to each metric and showing that for suitable choices of null tetrad, the algorithm leads to the same invariants and linear isotropy groups for both, establishing their equivalence. While it is well-known that the Taub-NUT solution and its self-dual version admit a double Kerr-Schild form, the observation that the self-dual Taub-NUT instanton admits a single Kerr-Schild form has only been made very recently. The two metrics we compare may be regarded as either complex metrics with Lorentzian (1,3) signature or real metrics with Kleinian (2,2) signature; here we take the latter view. Significant simplifications occur when the null tetrads are chosen to consist of two pairs of complex conjugate null vectors rather than four real independent ones. As a bonus, our work provides the first example of applying the Cartan-Karlhede algorithm using a null tetrad of this type.


title: Mitigating scattering in a quantum system using only an integrating sphere

abstract: Strong quantum-correlated sources are essential but delicate resources for quantum information science and engineering protocols. Decoherence and loss are the two main disruptive processes that lead to the loss of nonclassical behavior in quantum correlations. In quantum systems, scattering can contribute to both decoherence and loss. In this work, we present an experimental scheme capable of significantly mitigating the adverse impact of scattering in quantum systems. Our quantum system is composed of a two-mode squeezed light generated with the four-wave mixing process in hot rubidium vapor, and a scatterer is introduced to one of the two modes. An integrating sphere is then placed after the scatterer to recollect the scattered photons. We use mutual information between the two modes as the measure of quantum correlations, and demonstrate a 47.5% mutual information recovery from scattering, despite an enormous photon loss of greater than 85%. Our scheme is a pioneering step towards recovering quantum correlations from disruptive random processes, thus has the potential to bridge the gap between proof-of-principle demonstrations and practical real-world deployments of quantum protocols.


title: Multicalibration for Censored Survival Data: Towards Universal Adaptability in Predictive Modeling

abstract: Traditional statistical and machine learning methods assume identical distribution for the training and test data sets. This assumption, however, is often violated in real applications, particularly in health care research, where the training data~(source) may underrepresent specific subpopulations in the testing or target domain. Such disparities, coupled with censored observations, present significant challenges for investigators aiming to make predictions for those minority groups. This paper focuses on target-independent learning under covariate shift, where we study multicalibration for survival probability and restricted mean survival time, and propose a black-box post-processing boosting algorithm designed for censored survival data. Our algorithm, leveraging the pseudo observations, yields a multicalibrated predictor competitive with propensity scoring regarding predictions on the unlabeled target domain, not just overall but across diverse subpopulations. Our theoretical analysis for pseudo observations relies on functional delta method and $p$-variational norm. We further investigate the algorithm's sample complexity and convergence properties, as well as the multicalibration guarantee for post-processed predictors. Our theoretical insights reveal the link between multicalibration and universal adaptability, suggesting that our calibrated function performs comparably to, if not better than, the inverse propensity score weighting estimator. The performance of our proposed methods is corroborated through extensive numerical simulations and a real-world case study focusing on prediction of cardiovascular disease risk in two large prospective cohort studies. These empirical results confirm its potential as a powerful tool for predictive analysis with censored outcomes in diverse and shifting populations.


title: Daemonic quantum battery charged by thermalization

abstract: The reduced state of a small system strongly coupled to a charger in thermal equilibrium may be athermal and used as a small battery once disconnected. By harnessing the battery-charger correlations, the battery's extractable energy can increase above the ergotropy. We introduce a protocol that uses a quantum system as a memory that measures the charger and leaves the battery intact in its charged state. Using the information gained from the measurement, the daemonic ergotropy of the battery is extracted. Then the battery is reconnected to the charger, thermalizing and charging it. However, the memory should return to its initial standard state to close the thermodynamic cycle. Thus, on the one hand, the work cost of the cycle is the sum of the disconnecting and reconnecting battery-charger work plus the measurement and erasure work. On the other hand, the extracted energy is the daemonic ergotropy of the battery plus the ergotropy of the memory. The ratio of these quantities defines the efficiency of the cycle. The protocol is exemplified by a modified transverse spin 1/2 Ising chain, one spin functioning as the battery and the others as the charger. The memory is another auxiliary spin 1/2. We found pairs of measurement schemes from which we extract the same daemonic ergotropy from the battery, they dissipate the same amount of energy, and one leaves the memory in an active state, the other in a passive state. We study the memory's ergotropy and the daemonic ergotropy of the battery. We find that with measurements, the efficiency can surpass that of the unmeasured protocol, given conditions on temperature, coupling, and choice of the measurement operators.


title: A Systematic Bias of Machine Learning Regression Models and Its Correction: an Application to Imaging-based Brain Age Prediction

abstract: Machine learning models for continuous outcomes often yield systematically biased predictions, particularly for values that largely deviate from the mean. Specifically, predictions for large-valued outcomes tend to be negatively biased, while those for small-valued outcomes are positively biased. We refer to this linear central tendency warped bias as the "systematic bias of machine learning regression". In this paper, we first demonstrate that this issue persists across various machine learning models, and then delve into its theoretical underpinnings. We propose a general constrained optimization approach designed to correct this bias and develop a computationally efficient algorithm to implement our method. Our simulation results indicate that our correction method effectively eliminates the bias from the predicted outcomes. We apply the proposed approach to the prediction of brain age using neuroimaging data. In comparison to competing machine learning models, our method effectively addresses the longstanding issue of "systematic bias of machine learning regression" in neuroimaging-based brain age calculation, yielding unbiased predictions of brain age.


title: Non-invertible SPT, gauging and symmetry fractionalization

abstract: We explicitly realize the Rep($Q_8$) non-invertible symmetry-protected topological (SPT) state as a 1+1d cluster state on a tensor product Hilbert space of qubits. Using the Kramers-Wannier operator, we construct the lattice models for the phases of all the symmetries in the Rep($Q_8$) duality web. We further show that we can construct a class of lattice models with Rep($G$) symmetry including non-invertible SPT phases if they have a dual anomalous abelian symmetry. Upon dualizing, there is a rich interplay between onsite symmetries, non-onsite symmetries, non-abelian symmetries, and non-invertible symmetries. We show that these interplay can be explained using the symmetry fractionalization in the 2+1d bulk SET.


title: Theoretical guarantees for lifted samplers

abstract: Lifted samplers form a class of Markov chain Monte Carlo methods which has drawn a lot attention in recent years due to superior performance in challenging Bayesian applications. A canonical example of such sampler is the one that is derived from a random walk Metropolis algorithm for a totally-ordered state space such as the integers or the real numbers. The lifted sampler is derived by splitting into two the proposal distribution: one part in the increasing direction, and the other part in the decreasing direction. It keeps following a direction, until a rejection, upon which it flips the direction. In terms of asymptotic variances, it outperforms the random walk Metropolis algorithm, regardless of the target distribution, at no additional computational cost. Other studies show, however, that beyond this simple case, lifted samplers do not always outperform their Metropolis counterparts. In this paper, we leverage the celebrated work of Tierney (1998) to provide an analysis in a general framework encompassing a broad class of lifted samplers. Our finding is that, essentially, the asymptotic variances cannot increase by a factor of more than 2, regardless of the target distribution, the way the directions are induced, and the type of algorithm from which the lifted sampler is derived (be it a Metropolis--Hastings algorithm, a reversible jump algorithm, etc.). This result indicates that, while there is potentially a lot to gain from lifting a sampler, there is not much to lose.


title: Activator: GLU Activations as The Core Functions of a Vision Transformer

abstract: Transformer architecture currently represents the main driver behind many successes in a variety of tasks addressed by deep learning, especially the recent advances in natural language processing (NLP) culminating with large language models (LLM). In addition, transformer architecture has found a wide spread of interest from computer vision (CV) researchers and practitioners, allowing for many advancements in vision-related tasks and opening the door for multi-task and multi-modal deep learning architectures that share the same principle of operation. One drawback to these architectures is their reliance on the scaled dot product attention mechanism with the softmax activation function, which is computationally expensive and requires large compute capabilities both for training and inference. This paper investigates substituting the attention mechanism usually adopted for transformer architecture with an architecture incorporating gated linear unit (GLU) activation within a multi-layer perceptron (MLP) structure in conjunction with the default MLP incorporated in the traditional transformer design. Another step forward taken by this paper is to eliminate the second non-gated MLP to further reduce the computational cost. Experimental assessments conducted by this research show that both proposed modifications and reductions offer competitive performance in relation to baseline architectures, in support of the aims of this work in establishing a more efficient yet capable alternative to the traditional attention mechanism as the core component in designing transformer architectures.


title: Searches for new physics below twice the electron mass with GERDA

abstract: A search for full energy depositions from bosonic keV-scale dark matter candidates of masses between 65 keV and 1021 keV has been performed with data collected during Phase II of the GERmanium Detector Array (GERDA) experiment. Our analysis includes direct dark matter absorption as well as dark Compton scattering. With a total exposure of 105.5 kg yr, no evidence for a signal above the background has been observed. The resulting exclusion limits deduced with either Bayesian or Frequentist statistics are the most stringent direct constraints in the major part of the 140-1021 keV mass range. As an example, at a mass of 150 keV the dimensionless coupling of dark photons and axion-like particles to electrons has been constrained to $\alpha$'/$\alpha$ < 8.7x10$^{-24}$ and g$_{ae}$ < 3.3x10$^{-12}$ at 90% credible interval (CI), respectively. Additionally, a search for peak-like signals from beyond the Standard Model decays of nucleons and electrons is performed. We find for the inclusive decay of a single neutron in $^{76}$Ge a lower lifetime limit of $\tau_n$ > 1.5x10$^{24}$ yr and for a proton $\tau_p$ > 1.3x10$^{24}$ yr at 90% CI. For the electron decay e$^-\rightarrow\nu_e\gamma$ a lower limit of $\tau_e$ > 5.4x10$^{25}$ yr at 90% CI has been determined.


title: Anomaly distinguishability in an asteroid analogue using quasi-monostatic experimental radar measurements

abstract: This study conducts a quantitative distinguishability analysis using quasi-monostatic experimental radar data to find a topographic and backpropagated tomographic reconstruction for an analogue of asteroid Itokawa (25143). In particular, we consider a combination of travel-time and wavefield backpropagation tomography using the time-frequency representation (TFR) and principal component analysis (PCA) approaches as filtering techniques. Furthermore, we hypothesise that the travel time of the main peaks in the signal can be projected as a topographic imaging of the analogue asteroid while also presenting a tomographic reconstruction based on the main peaks in the signal. We compare the performance of several different filtering approaches covering several noise levels and two hypothetical interior structures: homogeneous and detailed. Our results suggest that wavefield information is vital for obtaining an appropriate reconstruction quality regardless of the noise level and that different filters affect the distinguishability under different assumptions of the noise. The results also suggest that the main peaks of the measured signal can be used to topographically distinguish the signatures in the measurements, hence the interior structure of the different analogue asteroids. Similarly, a tomographic reconstruction with the main peaks of the measured signal can be used to distinguish the interior structure of the different analogue asteroids.


title: CFGs: Causality Constrained Counterfactual Explanations using goal-directed ASP

abstract: Machine learning models that automate decision-making are increasingly used in consequential areas such as loan approvals, pretrial bail approval, and hiring. Unfortunately, most of these models are black boxes, i.e., they are unable to reveal how they reach these prediction decisions. A need for transparency demands justification for such predictions. An affected individual might also desire explanations to understand why a decision was made. Ethical and legal considerations require informing the individual of changes in the input attribute (s) that could be made to produce a desirable outcome. Our work focuses on the latter problem of generating counterfactual explanations by considering the causal dependencies between features. In this paper, we present the framework CFGs, CounterFactual Generation with s(CASP), which utilizes the goal-directed Answer Set Programming (ASP) system s(CASP) to automatically generate counterfactual explanations from models generated by rule-based machine learning algorithms in particular. We benchmark CFGs with the FOLD-SE model. Reaching the counterfactual state from the initial state is planned and achieved using a series of interventions. To validate our proposal, we show how counterfactual explanations are computed and justified by imagining worlds where some or all factual assumptions are altered/changed. More importantly, we show how CFGs navigates between these worlds, namely, go from our initial state where we obtain an undesired outcome to the imagined goal state where we obtain the desired decision, taking into account the causal relationships among features.


title: Translators of the mean curvature flow in the special linear group $SL(2,\mathbb{R})$

abstract: Translators in the special linear group $SL(2,\mathbb{R})$ are surfaces whose mean curvature $H$ and unit normal vector $N$ satisfy $H=\langle N,X\rangle$, where $X$ is a fixed Killing vector field. In this paper we study and classify those translators that are invariant by a one-parameter group of isometries. By the Iwasawa decomposition, there are three types of such groups. The dimension of the Killing vector fields is $4$ and an exhaustive discussion is done for each one of the Killing vector fields and each of the invariant surfaces. In some cases, explicit parametrizations of translators are obtained.


title: Theoretical model for multi-orbital Kondo screening in strongly correlated molecules with several unpaired electrons

abstract: The mechanism of Kondo screening in strongly correlated molecules with several unpaired electrons on a metal surface is still under debate. Here, we provide a theoretical framework that rationalizes the emergence of Kondo screening involving several extended molecular orbitals with unpaired electrons. We introduce a perturbative model, which provides simple rules to identify the presence of antiferromagnetic spin-flip channels involving charged molecular multiplets responsible for Kondo screening. The Kondo regime is confirmed by numerical renormalization group calculations. In addition, we introduce the concept of Kondo orbitals as molecular orbitals associated with the Kondo screening process, which provide a direct interpretation of experimental $dI/dV$ maps of Kondo resonances. We demonstrate that this theoretical framework can be applied to different strongly correlated open-shell molecules on metal surfaces, obtaining good agreement with previously published experimental data.


title: Generalized Dimension Reduction Using Semi-Relaxed Gromov-Wasserstein Distance

abstract: Dimension reduction techniques typically seek an embedding of a high-dimensional point cloud into a low-dimensional Euclidean space which optimally preserves the geometry of the input data. Based on expert knowledge, one may instead wish to embed the data into some other manifold or metric space in order to better reflect the geometry or topology of the point cloud. We propose a general method for manifold-valued multidimensional scaling based on concepts from optimal transport. In particular, we establish theoretical connections between the recently introduced semi-relaxed Gromov-Wasserstein (srGW) framework and multidimensional scaling by solving the Monge problem in this setting. We also derive novel connections between srGW distance and Gromov-Hausdorff distance. We apply our computational framework to analyze ensembles of political redistricting plans for states with two Congressional districts, achieving an effective visualization of the ensemble as a distribution on a circle which can be used to characterize typical neutral plans, and to flag outliers.


title: Human-Centered Automation

abstract: The rapid advancement of Generative Artificial Intelligence (AI), such as Large Language Models (LLMs) and Multimodal Large Language Models (MLLM), has the potential to revolutionize the way we work and interact with digital systems across various industries. However, the current state of software automation, such as Robotic Process Automation (RPA) frameworks, often requires domain expertise and lacks visibility and intuitive interfaces, making it challenging for users to fully leverage these technologies. This position paper argues for the emerging area of Human-Centered Automation (HCA), which prioritizes user needs and preferences in the design and development of automation systems. Drawing on empirical evidence from human-computer interaction research and case studies, we highlight the importance of considering user perspectives in automation and propose a framework for designing human-centric automation solutions. The paper discusses the limitations of existing automation approaches, the challenges in integrating AI and RPA, and the benefits of human-centered automation for productivity, innovation, and democratizing access to these technologies. We emphasize the importance of open-source solutions and provide examples of how HCA can empower individuals and organizations in the era of rapidly progressing AI, helping them remain competitive. The paper also explores pathways to achieve more advanced and context-aware automation solutions. We conclude with a call to action for researchers and practitioners to focus on developing automation technologies that adapt to user needs, provide intuitive interfaces, and leverage the capabilities of high-end AI to create a more accessible and user-friendly future of automation.


title: Grounding Stylistic Domain Generalization with Quantitative Domain Shift Measures and Synthetic Scene Images

abstract: Domain Generalization (DG) is a challenging task in machine learning that requires a coherent ability to comprehend shifts across various domains through extraction of domain-invariant features. DG performance is typically evaluated by performing image classification in domains of various image styles. However, current methodology lacks quantitative understanding about shifts in stylistic domain, and relies on a vast amount of pre-training data, such as ImageNet1K, which are predominantly in photo-realistic style with weakly supervised class labels. Such a data-driven practice could potentially result in spurious correlation and inflated performance on DG benchmarks. In this paper, we introduce a new DG paradigm to address these risks. We first introduce two new quantitative measures ICV and IDD to describe domain shifts in terms of consistency of classes within one domain and similarity between two stylistic domains. We then present SuperMarioDomains (SMD), a novel synthetic multi-domain dataset sampled from video game scenes with more consistent classes and sufficient dissimilarity compared to ImageNet1K. We demonstrate our DG method SMOS. SMOS first uses SMD to train a precursor model, which is then used to ground the training on a DG benchmark. We observe that SMOS contributes to state-of-the-art performance across five DG benchmarks, gaining large improvements to performances on abstract domains along with on-par or slight improvements to those on photo-realistic domains. Our qualitative analysis suggests that these improvements can be attributed to reduced distributional divergence between originally distant domains. Our data are available at https://github.com/fpsluozi/SMD-SMOS .


title: Wearable-based behaviour interpolation for semi-supervised human activity recognition

abstract: While traditional feature engineering for Human Activity Recognition (HAR) involves a trial-anderror process, deep learning has emerged as a preferred method for high-level representations of sensor-based human activities. However, most deep learning-based HAR requires a large amount of labelled data and extracting HAR features from unlabelled data for effective deep learning training remains challenging. We, therefore, introduce a deep semi-supervised HAR approach, MixHAR, which concurrently uses labelled and unlabelled activities. Our MixHAR employs a linear interpolation mechanism to blend labelled and unlabelled activities while addressing both inter- and intra-activity variability. A unique challenge identified is the activityintrusion problem during mixing, for which we propose a mixing calibration mechanism to mitigate it in the feature embedding space. Additionally, we rigorously explored and evaluated the five conventional/popular deep semi-supervised technologies on HAR, acting as the benchmark of deep semi-supervised HAR. Our results demonstrate that MixHAR significantly improves performance, underscoring the potential of deep semi-supervised techniques in HAR.


title: Learning Minimum Linear Arrangement of Cliques and Lines

abstract: In the well-known Minimum Linear Arrangement problem (MinLA), the goal is to arrange the nodes of an undirected graph into a permutation so that the total stretch of the edges is minimized. This paper studies an online (learning) variant of MinLA where the graph is not given at the beginning, but rather revealed piece-by-piece. The algorithm starts in a fixed initial permutation, and after a piece of the graph is revealed, the algorithm must update its current permutation to be a MinLA of the subgraph revealed so far. The objective is to minimize the total number of swaps of adjacent nodes as the algorithm updates the permutation. The main result of this paper is an online randomized algorithm that solves this online variant for the restricted cases where the revealed graph is either a collection of cliques or a collection of lines. We show that the algorithm is $8 \ln n$-competitive, where $n$ is the number of nodes of the graph. We complement this result by constructing an asymptotically matching lower bound of $\Omega(\ln n)$.


title: A hierarchical Bayesian model for syntactic priming

abstract: The effect of syntactic priming exhibits three well-documented empirical properties: the lexical boost, the inverse frequency effect, and the asymmetrical decay. We aim to show how these three empirical phenomena can be reconciled in a general learning framework, the hierarchical Bayesian model (HBM). The model represents syntactic knowledge in a hierarchical structure of syntactic statistics, where a lower level represents the verb-specific biases of syntactic decisions, and a higher level represents the abstract bias as an aggregation of verb-specific biases. This knowledge is updated in response to experience by Bayesian inference. In simulations, we show that the HBM captures the above-mentioned properties of syntactic priming. The results indicate that some properties of priming which are usually explained by a residual activation account can also be explained by an implicit learning account. We also discuss the model's implications for the lexical basis of syntactic priming.


title: What is a Goldilocks Face Verification Test Set?

abstract: Face Recognition models are commonly trained with web-scraped datasets containing millions of images and evaluated on test sets emphasizing pose, age and mixed attributes. With train and test sets both assembled from web-scraped images, it is critical to ensure disjoint sets of identities between train and test sets. However, existing train and test sets have not considered this. Moreover, as accuracy levels become saturated, such as LFW $>99.8\%$, more challenging test sets are needed. We show that current train and test sets are generally not identity- or even image-disjoint, and that this results in an optimistic bias in the estimated accuracy. In addition, we show that identity-disjoint folds are important in the 10-fold cross-validation estimate of test accuracy. To better support continued advances in face recognition, we introduce two "Goldilocks" test sets, Hadrian and Eclipse. The former emphasizes challenging facial hairstyles and latter emphasizes challenging over- and under-exposure conditions. Images in both datasets are from a large, controlled-acquisition (not web-scraped) dataset, so they are identity- and image-disjoint with all popular training sets. Accuracy for these new test sets generally falls below that observed on LFW, CPLFW, CALFW, CFP-FP and AgeDB-30, showing that these datasets represent important dimensions for improvement of face recognition. The datasets are available at: \url{https://github.com/HaiyuWu/SOTA-Face-Recognition-Train-and-Test}


title: Quantitative stability of Sobolev inequalities on compact Riemannian manifolds

abstract: We study quantitative stability results for different classes of Sobolev inequalities on general compact Riemannian manifolds. We prove that, up to constants depending on the manifold, a function that nearly saturates a critical Sobolev inequality is quantitatively $W^{1,2}$-close to a non-empty set of extremal functions, provided that the corresponding optimal Sobolev constant satisfies a suitable strict bound. The case of sub-critical Sobolev inequalities is also covered. Finally, we discuss degenerate phenomena in our quantitative controls.


title: 3-Minute Oscillations in the Upper Corona: Evidence from Parker Solar Probe

abstract: Recent observations of Parker Solar Probe (PSP) from around the Alfv\'en surface have shown that the trace magnetic power spectrum density (PSD) is often characterized by a shallow-inertial double power law, where in the low frequency energy injection range, the power spectrum is shallow (flatter than $1/f$), and in the inertial range the spectrum is steep, with a scaling index of [1.5, 1.67]. Consequently, close to the sun, the majority of the fluctuation energy concentrates in a small frequency range around the low frequency power spectral break. In this work, we conduct a systematic survey of PSP observations for the first 17 encounters to statistically study the energy behaviors of the magnetic fluctuations. Our results show that the center frequency of fluctuation energy systematically drifts to around 3-minute for the most pristine solar wind (smallest solar wind advection time). Moreover, the center frequency rapidly drifts to lower frequency as solar wind advection time increases, as expected for active turbulence. The concentration of fluctuation energy around 3-minutes suggests that Alfv\'enic fluctuations in solar wind might mostly be coming from resonant p-mode oscillations in the photosphere, though other potential sources are discussed.


title: Spatial modeling algorithms for reactions and transport (SMART) in biological cells

abstract: Biological cells rely on precise spatiotemporal coordination of biochemical reactions to control their many functions. Such cell signaling networks have been a common focus for mathematical models, but they remain challenging to simulate, particularly in realistic cell geometries. Herein, we present our software, Spatial Modeling Algorithms for Reactions and Transport (SMART), a package that takes in high-level user specifications about cell signaling networks and molecular transport, and then assembles and solves the associated mathematical and computational systems. SMART uses state-of-the-art finite element analysis, via the FEniCS Project software, to efficiently and accurately resolve cell signaling events over discretized cellular and subcellular geometries. We demonstrate its application to several different biological systems, including YAP/TAZ mechanotransduction, calcium signaling in neurons and cardiomyocytes, and ATP generation in mitochondria. Throughout, we utilize experimentally-derived realistic cellular geometries represented by well-conditioned tetrahedral meshes. These scenarios demonstrate the applicability, flexibility, accuracy and efficiency of SMART across a range of temporal and spatial scales.


title: Massive Digital Over-the-Air Computation for Communication-Efficient Federated Edge Learning

abstract: Over-the-air computation (AirComp) is a promising technology converging communication and computation over wireless networks, which can be particularly effective in model training, inference, and more emerging edge intelligence applications. AirComp relies on uncoded transmission of individual signals, which are added naturally over the multiple access channel thanks to the superposition property of the wireless medium. Despite significantly improved communication efficiency, how to accommodate AirComp in the existing and future digital communication networks, that are based on discrete modulation schemes, remains a challenge. This paper proposes a massive digital AirComp (MD-AirComp) scheme, that leverages an unsourced massive access protocol, to enhance compatibility with both current and next-generation wireless networks. MD-AirComp utilizes vector quantization to reduce the uplink communication overhead, and employs shared quantization and modulation codebooks. At the receiver, we propose a near-optimal approximate message passing-based algorithm to compute the model aggregation results from the superposed sequences, which relies on estimating the number of devices transmitting each code sequence, rather than trying to decode the messages of individual transmitters. We apply MD-AirComp to the federated edge learning (FEEL), and show that it significantly accelerates FEEL convergence compared to state-of-the-art while using the same amount of communication resources. To support further research and ensure reproducibility, we have made our code available at https://github.com/liqiao19/MD-AirComp.


title: Bounding deformation spaces of Kleinian groups with two generators

abstract: In this article we provide simple and provable bounds on the size and shape of the quasiconformal deformation space of the groups $\IZ_p*\IZ_q$, the free product of cyclic groups of order $p$ and $q$, in $\PSL(2,\IC)$ for $3\leq p,q \leq \infty$. Though simple, these bounds are sharp, meeting the highly fractal boundary of the deformation space in four cusp groups. Such bounds have great utility in computer assisted searches for extremal Kleinian groups so as to identify universal constraints (volume, length spectra, etc) on the geometry and topology of hyperbolic $3$-orbifolds. As an application, we prove a strengthened version of a conjecture by Morier-Genoud, Ovsienko, and Veselov on the faithfulness of the specialised Burau representation.


title: Robust width: A lightweight and certifiable adversarial defense

abstract: Deep neural networks are vulnerable to so-called adversarial examples: inputs which are intentionally constructed to cause the model to make incorrect predictions or classifications. Adversarial examples are often visually indistinguishable from natural data samples, making them hard to detect. As such, they pose significant threats to the reliability of deep learning systems. In this work, we study an adversarial defense based on the robust width property (RWP), which was recently introduced for compressed sensing. We show that a specific input purification scheme based on the RWP gives theoretical robustness guarantees for images that are approximately sparse. The defense is easy to implement and can be applied to any existing model without additional training or finetuning. We empirically validate the defense on ImageNet against $L^\infty$ perturbations at perturbation budgets ranging from $4/255$ to $32/255$. In the black-box setting, our method significantly outperforms the state-of-the-art, especially for large perturbations. In the white-box setting, depending on the choice of base classifier, we closely match the state of the art in robust ImageNet classification while avoiding the need for additional data, larger models or expensive adversarial training routines. Our code is available at https://github.com/peck94/robust-width-defense.


title: SMILES Initial Data Release: Unveiling the Obscured Universe with MIRI Multi-band Imaging

abstract: The James Webb Space Telescope (JWST) is revolutionizing our view of the Universe through unprecedented sensitivity and resolution in the infrared, with some of the largest gains realized at its longest wavelengths. We present the Systematic Mid-infrared Instrument (MIRI) Legacy Extragalactic Survey (SMILES), an eight-band MIRI survey with Near-Infrared Spectrograph (NIRSpec) spectroscopic follow-up in the GOODS-S/HUDF region. SMILES takes full advantage of MIRI's continuous coverage from $5.6-25.5\,\mu$m over a $\sim34$ arcmin$^2$ area to greatly expand our understanding of the obscured Universe up to cosmic noon and beyond. This work, together with a companion paper by Rieke et al., covers the SMILES science drivers and technical design, early results with SMILES, data reduction, photometric catalog creation, and the first data release. As part of the discussion on early results, we additionally present a high-level science demonstration on how MIRI's wavelength coverage and resolution will advance our understanding of cosmic dust using the full range of polycyclic aromatic hydrocarbon (PAH) emission features from $3.3-18\,\mu$m. Using custom background subtraction, we produce robust reductions of the MIRI imaging that maximize the depths reached with our modest exposure times ($\sim0.6 - 2.2$ ks per filter). Included in our initial data release are (1) eight MIRI imaging mosaics reaching depths of $0.2-18\,\mu$Jy ($5\sigma$) and (2) a $5-25.5\,\mu$m photometric catalog with over 3,000 sources. Building upon the rich legacy of extensive photometric and spectroscopy coverage of GOODS-S/HUDF from the X-ray to the radio, SMILES greatly expands our investigative power in understanding the obscured Universe.


title: Enhancing Visual-Language Modality Alignment in Large Vision Language Models via Self-Improvement

abstract: Large vision-language models (LVLMs) have achieved impressive results in various visual question-answering and reasoning tasks through vision instruction tuning on specific datasets. However, there is still significant room for improvement in the alignment between visual and language modalities. Previous methods to enhance this alignment typically require external models or data, heavily depending on their capabilities and quality, which inevitably sets an upper bound on performance. In this paper, we propose SIMA, a framework that enhances visual and language modality alignment through self-improvement, eliminating the needs for external models or data. SIMA leverages prompts from existing vision instruction tuning datasets to self-generate responses and employs an in-context self-critic mechanism to select response pairs for preference tuning. The key innovation is the introduction of three vision metrics during the in-context self-critic process, which can guide the LVLM in selecting responses that enhance image comprehension. Through experiments across 14 hallucination and comprehensive benchmarks, we demonstrate that SIMA not only improves model performance across all benchmarks but also achieves superior modality alignment, outperforming previous approaches.


title: The Anti-Coincidence Detector Subsystem for ComPair

abstract: ComPair is a prototype gamma-ray telescope for the development of key technologies for next-generation gamma-ray detectors consisting of four subsystems: a 10-layer double-sided silicon strip detector tracker, a cadmium zinc telluride calorimeter, a cesium iodide calorimeter, and a plastic anti-coincidence detector (ACD). The ACD acts as an active shield to veto charged particle events and consists of 5 plastic scintillating panels. ComPair was launched as a balloon payload from Ft. Sumner, New Mexico and completed a 6-hour flight on August 27, 2023. Here we detail the design adn calibration of the ComPair ACD, and report on the ACD's veto efficiency and other performance metrics during the ComPair fight.


title: Inference of Utilities and Time Preference in Sequential Decision-Making

abstract: This paper introduces a novel stochastic control framework to enhance the capabilities of automated investment managers, or robo-advisors, by accurately inferring clients' investment preferences from past activities. Our approach leverages a continuous-time model that incorporates utility functions and a generic discounting scheme of a time-varying rate, tailored to each client's risk tolerance, valuation of daily consumption, and significant life goals. We address the resulting time inconsistency issue through state augmentation and the establishment of the dynamic programming principle and the verification theorem. Additionally, we provide sufficient conditions for the identifiability of client investment preferences. To complement our theoretical developments, we propose a learning algorithm based on maximum likelihood estimation within a discrete-time Markov Decision Process framework, augmented with entropy regularization. We prove that the log-likelihood function is locally concave, facilitating the fast convergence of our proposed algorithm. Practical effectiveness and efficiency are showcased through two numerical examples, including Merton's problem and an investment problem with unhedgeable risks. Our proposed framework not only advances financial technology by improving personalized investment advice but also contributes broadly to other fields such as healthcare, economics, and artificial intelligence, where understanding individual preferences is crucial.


title: Understanding the Impact of Training Set Size on Animal Re-identification

abstract: Recent advancements in the automatic re-identification of animal individuals from images have opened up new possibilities for studying wildlife through camera traps and citizen science projects. Existing methods leverage distinct and permanent visual body markings, such as fur patterns or scars, and typically employ one of two strategies: local features or end-to-end learning. In this study, we delve into the impact of training set size by conducting comprehensive experiments across six different methods and five animal species. While it is well known that end-to-end learning-based methods surpass local feature-based methods given a sufficient amount of good-quality training data, the challenge of gathering such datasets for wildlife animals means that local feature-based methods remain a more practical approach for many species. We demonstrate the benefits of both local feature and end-to-end learning-based approaches and show that species-specific characteristics, particularly intra-individual variance, have a notable effect on training data requirements.


title: Transmission grating arrays for the X-ray spectrometer on Arcus Probe

abstract: The Arcus Probe mission concept has been submitted as an Astrophysics Probe Explorer candidate. It features two co-aligned high-resolution grating spectrometers: one for the soft x-ray band and one for the far UV. Together, these instruments can provide unprecedented performance to address important key questions about the structure and dynamics of our universe across a large range of length scales. The X-ray Spectrometer (XRS) consists of four parallel optical channels, each featuring an x-ray telescope with a fixed array of 216 lightweight, high-efficiency blazed transmission gratings, and two CCD readout arrays. Average spectral resolving power $\lambda/\Delta \lambda > 2,500$ ($\sim 3500$ expected) across the 12-50 \AA \ band and combined effective area $> 350$ cm$^2$ ($> 470$ cm$^2$ expected) near OVII wavelengths are predicted, based on the measured x-ray performance of spectrometer prototypes and detailed ray trace modeling. We describe the optical and structural design of the grating arrays, from the macroscopic grating petals to the nanoscale gratings bars, grating fabrication, alignment, and x-ray testing. Recent x-ray diffraction efficiency results from chemically thinned grating bars are presented and show performance above mission assumptions.


title: Exploring Age-of-Information Weighting in Federated Learning under Data Heterogeneity

abstract: This paper investigates federated learning in a wireless communication system, where random device selection is employed with non-independent and identically distributed (non-IID) data. The analysis indicates that while training deep learning networks using federated stochastic gradient descent (FedSGD) on non-IID datasets, device selection can generate gradient errors that accumulate, leading to potential weight divergence. To mitigate training divergence, we design an age-weighted FedSGD to scale local gradients according to the previous state of devices. To further improve learning performance by increasing device participation under the maximum time consumption constraint, we formulate an energy consumption minimization problem by including resource allocation and sub-channel assignment. By transforming the resource allocation problem into convex and utilizing KKT conditions, we derived the optimal resource allocation solution. Moreover, this paper develops a matching based algorithm to generate the enhanced sub-channel assignment. Simulation results indicate that i) age-weighted FedSGD is able to outperform conventional FedSGD in terms of convergence rate and achievable accuracy, and ii) the proposed resource allocation and sub-channel assignment strategies can significantly reduce energy consumption and improve learning performance by increasing the number of selected devices.


title: BadGD: A unified data-centric framework to identify gradient descent vulnerabilities

abstract: We present BadGD, a unified theoretical framework that exposes the vulnerabilities of gradient descent algorithms through strategic backdoor attacks. Backdoor attacks involve embedding malicious triggers into a training dataset to disrupt the model's learning process. Our framework introduces three novel constructs: Max RiskWarp Trigger, Max GradWarp Trigger, and Max GradDistWarp Trigger, each designed to exploit specific aspects of gradient descent by distorting empirical risk, deterministic gradients, and stochastic gradients respectively. We rigorously define clean and backdoored datasets and provide mathematical formulations for assessing the distortions caused by these malicious backdoor triggers. By measuring the impact of these triggers on the model training procedure, our framework bridges existing empirical findings with theoretical insights, demonstrating how a malicious party can exploit gradient descent hyperparameters to maximize attack effectiveness. In particular, we show that these exploitations can significantly alter the loss landscape and gradient calculations, leading to compromised model integrity and performance. This research underscores the severe threats posed by such data-centric attacks and highlights the urgent need for robust defenses in machine learning. BadGD sets a new standard for understanding and mitigating adversarial manipulations, ensuring the reliability and security of AI systems.


title: Twisted first moment of central values of primitive quadratic Dirichlet $L$-functions

abstract: We evaluate the twisted first moment of central values of the family of primitive quadratic Dirichlet $L$-functions using the method of double Dirichlet series together with a recursive argument. Our main result is an asymptotic formula with an error term of size that is the square root of that of the main term.


title: A numerical method for designing topological superconductors induced by s-wave superconductivity

abstract: Topological superconductors, as one of the most important research directions at present, have attracted much attention because of their potential to realize topological quantum computation. However, a universal computational tool based on first-principle calculations for topological superconductivity was not yet fully developed, and eventually significant challenges in predicting topological superconducting materials. It is difficult to calculate the topological superconducting properties of the system in a self-consistent manner. In this paper, we develop a numerical method to characterize the superconducting band spectrum and superconducting topological invariants of two-dimensional (2D) slab system from first-principles calculations and implemented in an open-source software WannierTools. We hope that it would accelerate the discovery of the topological superconductor candidates.


title: Automated Assessment and Adaptive Multimodal Formative Feedback Improves Psychomotor Skills Training Outcomes in Quadrotor Teleoperation

abstract: The workforce will need to continually upskill in order to meet the evolving demands of industry, especially working with robotic and autonomous systems. Current training methods are not scalable and do not adapt to the skills that learners already possess. In this work, we develop a system that automatically assesses learner skill in a quadrotor teleoperation task using temporal logic task specifications. This assessment is used to generate multimodal feedback based on the principles of effective formative feedback. Participants perceived the feedback positively. Those receiving formative feedback viewed the feedback as more actionable compared to receiving summary statistics. Participants in the multimodal feedback condition were more likely to achieve a safe landing and increased their safe landings more over the experiment compared to other feedback conditions. Finally, we identify themes to improve adaptive feedback and discuss and how training for complex psychomotor tasks can be integrated with learning theories.


title: Hierarchical Clustering via Local Search

abstract: In this paper, we introduce a local search algorithm for hierarchical clustering. For the local step, we consider a tree re-arrangement operation, known as the {\em interchange}, which involves swapping two closely positioned sub-trees within a tree hierarchy. The interchange operation has been previously used in the context of phylogenetic trees. As the objective function for evaluating the resulting hierarchies, we utilize the revenue function proposed by Moseley and Wang (NIPS 2017.) In our main result, we show that any locally optimal tree guarantees a revenue of at least $\frac{n-2}{3}\sum_{i < j}w(i,j)$ where is $n$ the number of objects and $w: [n] \times [n] \rightarrow \mathbb{R}^+$ is the associated similarity function. This finding echoes the previously established bound for the average link algorithm as analyzed by Moseley and Wang. We demonstrate that this alignment is not coincidental, as the average link trees enjoy the property of being locally optimal with respect to the interchange operation. Consequently, our study provides an alternative insight into the average link algorithm and reveals the existence of a broader range of hierarchies with relatively high revenue achievable through a straightforward local search algorithm. Furthermore, we present an implementation of the local search framework, where each local step requires $O(n)$ computation time. Our empirical results indicate that the proposed method, used as post-processing step, can effectively generate a hierarchical clustering with substantial revenue.


title: Evaluating the Adversarial Robustness of Retrieval-Based In-Context Learning for Large Language Models

abstract: With the emergence of large language models, such as LLaMA and OpenAI GPT-3, In-Context Learning (ICL) gained significant attention due to its effectiveness and efficiency. However, ICL is very sensitive to the choice, order, and verbaliser used to encode the demonstrations in the prompt. Retrieval-Augmented ICL methods try to address this problem by leveraging retrievers to extract semantically related examples as demonstrations. While this approach yields more accurate results, its robustness against various types of adversarial attacks, including perturbations on test samples, demonstrations, and retrieved data, remains under-explored. Our study reveals that retrieval-augmented models can enhance robustness against test sample attacks, outperforming vanilla ICL with a 4.87% reduction in Attack Success Rate (ASR); however, they exhibit overconfidence in the demonstrations, leading to a 2% increase in ASR for demonstration attacks. Adversarial training can help improve the robustness of ICL methods to adversarial attacks; however, such a training scheme can be too costly in the context of LLMs. As an alternative, we introduce an effective training-free adversarial defence method, DARD, which enriches the example pool with those attacked samples. We show that DARD yields improvements in performance and robustness, achieving a 15% reduction in ASR over the baselines. Code and data are released to encourage further research: https://github.com/simonucl/adv-retreival-icl


title: The Impact and Opportunities of Generative AI in Fact-Checking

abstract: Generative AI appears poised to transform white collar professions, with more than 90% of Fortune 500 companies using OpenAI's flagship GPT models, which have been characterized as "general purpose technologies" capable of effecting epochal changes in the economy. But how will such technologies impact organizations whose job is to verify and report factual information, and to ensure the health of the information ecosystem? To investigate this question, we conducted 30 interviews with N=38 participants working at 29 fact-checking organizations across six continents, asking about how they use generative AI and the opportunities and challenges they see in the technology. We found that uses of generative AI envisioned by fact-checkers differ based on organizational infrastructure, with applications for quality assurance in Editing, for trend analysis in Investigation, and for information literacy in Advocacy. We used the TOE framework to describe participant concerns ranging from the Technological (lack of transparency), to the Organizational (resource constraints), to the Environmental (uncertain and evolving policy). Building on the insights of our participants, we describe value tensions between fact-checking and generative AI, and propose a novel Verification dimension to the design space of generative models for information verification work. Finally, we outline an agenda for fairness, accountability, and transparency research to support the responsible use of generative AI in fact-checking. Throughout, we highlight the importance of human infrastructure and labor in producing verified information in collaboration with AI. We expect that this work will inform not only the scientific literature on fact-checking, but also contribute to understanding of organizational adaptation to a powerful but unreliable new technology.


title: Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time Complexity

abstract: Diffusion models have become a leading method for generative modeling of both image and scientific data. As these models are costly to train and evaluate, reducing the inference cost for diffusion models remains a major goal. Inspired by the recent empirical success in accelerating diffusion models via the parallel sampling technique~\cite{shih2024parallel}, we propose to divide the sampling process into $\mathcal{O}(1)$ blocks with parallelizable Picard iterations within each block. Rigorous theoretical analysis reveals that our algorithm achieves $\widetilde{\mathcal{O}}(\mathrm{poly} \log d)$ overall time complexity, marking the first implementation with provable sub-linear complexity w.r.t. the data dimension $d$. Our analysis is based on a generalized version of Girsanov's theorem and is compatible with both the SDE and probability flow ODE implementations. Our results shed light on the potential of fast and efficient sampling of high-dimensional data on fast-evolving modern large-memory GPU clusters.


title: Modes of Analyzing Disinformation Narratives With AI/ML/Text Mining to Assist in Mitigating the Weaponization of Social Media

abstract: This paper highlights the developing need for quantitative modes for capturing and monitoring malicious communication in social media. There has been a deliberate "weaponization" of messaging through the use of social networks including by politically oriented entities both state sponsored and privately run. The article identifies a use of AI/ML characterization of generalized "mal-info," a broad term which includes deliberate malicious narratives similar with hate speech, which adversely impact society. A key point of the discussion is that this mal-info will dramatically increase in volume, and it will become essential for sharable quantifying tools to provide support for human expert intervention. Despite attempts to introduce moderation on major platforms like Facebook and X/Twitter, there are now established alternative social networks that offer completely unmoderated spaces. The paper presents an introduction to these platforms and the initial results of a qualitative and semi-quantitative analysis of characteristic mal-info posts. The authors perform a rudimentary text mining function for a preliminary characterization in order to evaluate the modes for better-automated monitoring. The action examines several inflammatory terms using text analysis and, importantly, discusses the use of generative algorithms by one political agent in particular, providing some examples of the potential risks to society. This latter is of grave concern, and monitoring tools must be established. This paper presents a preliminary step to selecting relevant sources and to setting a foundation for characterizing the mal-info, which must be monitored. The AI/ML methods provide a means for semi-quantitative signature capture. The impending use of "mal-GenAI" is presented.


title: Transductive Confidence Machine and its application to Medical Data Sets

abstract: The Transductive Confidence Machine Nearest Neighbours (TCMNN) algorithm and a supporting, simple user interface was developed. Different settings of the TCMNN algorithms' parameters were tested on medical data sets, in addition to the use of different Minkowski metrics and polynomial kernels. The effect of increasing the number of nearest neighbours and marking results with significance was also investigated. SVM implementation of the Transductive Confidence Machine was compared with Nearest Neighbours implementation. The application of neural networks was investigated as a useful comparison to the transductive algorithms.


title: TreeFormers -- An Exploration of Vision Transformers for Deforestation Driver Classification

abstract: This paper addresses the critical issue of deforestation by exploring the application of vision transformers (ViTs) for classifying the drivers of deforestation using satellite imagery from Indonesian forests. Motivated by the urgency of this problem, I propose an approach that leverages ViTs and machine learning techniques. The input to my algorithm is a 332x332-pixel satellite image, and I employ a ViT architecture to predict the deforestation driver class; grassland shrubland, other, plantation, or smallholder agriculture. My methodology involves fine-tuning a pre-trained ViT on a dataset from the Stanford ML Group, and I experiment with rotational data augmentation techniques (among others) and embedding of longitudinal data to improve classification accuracy. I also tried training a ViT from scratch. Results indicate a significant improvement over baseline models, achieving a test accuracy of 72.9%. I conduct a comprehensive analysis, including error patterns and metrics, to highlight the strengths and limitations of my approach. This research contributes to the ongoing efforts to address deforestation challenges through advanced computer vision techniques.


title: Exploring Jacobian Inexactness in Second-Order Methods for Variational Inequalities: Lower Bounds, Optimal Algorithms and Quasi-Newton Approximations

abstract: Variational inequalities represent a broad class of problems, including minimization and min-max problems, commonly found in machine learning. Existing second-order and high-order methods for variational inequalities require precise computation of derivatives, often resulting in prohibitively high iteration costs. In this work, we study the impact of Jacobian inaccuracy on second-order methods. For the smooth and monotone case, we establish a lower bound with explicit dependence on the level of Jacobian inaccuracy and propose an optimal algorithm for this key setting. When derivatives are exact, our method converges at the same rate as exact optimal second-order methods. To reduce the cost of solving the auxiliary problem, which arises in all high-order methods with global convergence, we introduce several Quasi-Newton approximations. Our method with Quasi-Newton updates achieves a global sublinear convergence rate. We extend our approach with a tensor generalization for inexact high-order derivatives and support the theory with experiments.


title: R\'enyi Neural Processes

abstract: Neural Processes (NPs) are variational frameworks that aim to represent stochastic processes with deep neural networks. Despite their obvious benefits in uncertainty estimation for complex distributions via data-driven priors, NPs enforce network parameter sharing between the conditional prior and posterior distributions, thereby risking introducing a misspecified prior. We hereby propose R\'enyi Neural Processes (RNP) to relax the influence of the misspecified prior and optimize a tighter bound of the marginal likelihood. More specifically, by replacing the standard KL divergence with the R\'enyi divergence between the posterior and the approximated prior, we ameliorate the impact of the misspecified prior via a parameter {\alpha} so that the resulting posterior focuses more on tail samples and reduce density on overconfident regions. Our experiments showed log-likelihood improvements on several existing NP families. We demonstrated the superior performance of our approach on various benchmarks including regression and image inpainting tasks. We also validate the effectiveness of RNPs on real-world tabular regression problems.


title: Data Complexity Estimates for Operator Learning

abstract: Operator learning has emerged as a new paradigm for the data-driven approximation of nonlinear operators. Despite its empirical success, the theoretical underpinnings governing the conditions for efficient operator learning remain incomplete. The present work develops theory to study the data complexity of operator learning, complementing existing research on the parametric complexity. We investigate the fundamental question: How many input/output samples are needed in operator learning to achieve a desired accuracy $\epsilon$? This question is addressed from the point of view of $n$-widths, and this work makes two key contributions. The first contribution is to derive lower bounds on $n$-widths for general classes of Lipschitz and Fr\'echet differentiable operators. These bounds rigorously demonstrate a ``curse of data-complexity'', revealing that learning on such general classes requires a sample size exponential in the inverse of the desired accuracy $\epsilon$. The second contribution of this work is to show that ``parametric efficiency'' implies ``data efficiency''; using the Fourier neural operator (FNO) as a case study, we show rigorously that on a narrower class of operators, efficiently approximated by FNO in terms of the number of tunable parameters, efficient operator learning is attainable in data complexity as well. Specifically, we show that if only an algebraically increasing number of tunable parameters is needed to reach a desired approximation accuracy, then an algebraically bounded number of data samples is also sufficient to achieve the same accuracy.


title: Efficient Multifidelity Uncertainty Propagation in the Presence of Process Noise

abstract: A multifidelity method for the nonlinear propagation of uncertainties in the presence of stochastic accelerations is presented. The proposed algorithm treats the uncertainty propagation (UP) problem by separating the propagation of the initial uncertainty from that of the process noise. The initial uncertainty is propagated using an adaptive Gaussian mixture model (GMM) method which exploits a low-fidelity dynamical model to minimize the computational costs. The effects of process noise are instead computed using the PoLynomial Algebra Stochastic Moments Analysis (PLASMA) technique, which considers a high-fidelity model of the stochastic dynamics. The main focus of the paper is on the latter and on the key idea to approximate the probability density function (pdf) of the solution by a polynomial representation of its moments, which are efficiently computed using differential algebra (DA) techniques. The two estimates are finally combined to restore the accuracy of the low-fidelity surrogate and account for both sources of uncertainty. The proposed approach is applied to the problem of nonlinear orbit UP and its performance compared to that of Monte Carlo (MC) simulations.


title: Verified Safe Reinforcement Learning for Neural Network Dynamic Models

abstract: Learning reliably safe autonomous control is one of the core problems in trustworthy autonomy. However, training a controller that can be formally verified to be safe remains a major challenge. We introduce a novel approach for learning verified safe control policies in nonlinear neural dynamical systems while maximizing overall performance. Our approach aims to achieve safety in the sense of finite-horizon reachability proofs, and is comprised of three key parts. The first is a novel curriculum learning scheme that iteratively increases the verified safe horizon. The second leverages the iterative nature of gradient-based learning to leverage incremental verification, reusing information from prior verification runs. Finally, we learn multiple verified initial-state-dependent controllers, an idea that is especially valuable for more complex domains where learning a single universal verified safe controller is extremely challenging. Our experiments on five safe control problems demonstrate that our trained controllers can achieve verified safety over horizons that are as much as an order of magnitude longer than state-of-the-art baselines, while maintaining high reward, as well as a perfect safety record over entire episodes.


title: Efficient Temporal Action Segmentation via Boundary-aware Query Voting

abstract: Although the performance of Temporal Action Segmentation (TAS) has improved in recent years, achieving promising results often comes with a high computational cost due to dense inputs, complex model structures, and resource-intensive post-processing requirements. To improve the efficiency while keeping the performance, we present a novel perspective centered on per-segment classification. By harnessing the capabilities of Transformers, we tokenize each video segment as an instance token, endowed with intrinsic instance segmentation. To realize efficient action segmentation, we introduce BaFormer, a boundary-aware Transformer network. It employs instance queries for instance segmentation and a global query for class-agnostic boundary prediction, yielding continuous segment proposals. During inference, BaFormer employs a simple yet effective voting strategy to classify boundary-wise segments based on instance segmentation. Remarkably, as a single-stage approach, BaFormer significantly reduces the computational costs, utilizing only 6% of the running time compared to state-of-the-art method DiffAct, while producing better or comparable accuracy over several popular benchmarks. The code for this project is publicly available at https://github.com/peiyao-w/BaFormer.


title: Selfie Taking with Facial Expression Recognition Using Omni-directional Camera

abstract: Recent studies have shown that visually impaired people have desires to take selfies in the same way as sighted people do to record their photos and share them with others. Although support applications using sound and vibration have been developed to help visually impaired people take selfies using smartphone cameras, it is still difficult to capture everyone in the angle of view, and it is also difficult to confirm that they all have good expressions in the photo. To mitigate these issues, we propose a method to take selfies with multiple people using an omni-directional camera. Specifically, a user takes a few seconds of video with an omni-directional camera, followed by face detection on all frames. The proposed method then eliminates false face detections and complements undetected ones considering the consistency across all frames. After performing facial expression recognition on all the frames, the proposed method finally extracts the frame in which the participants are happiest, and generates a perspective projection image in which all the participants are in the angle of view from the omni-directional frame. In experiments, we use several scenes with different number of people taken to demonstrate the effectiveness of the proposed method.


title: $\textit{UniSaT}$: Unified-Objective Belief Model and Planner to Search for and Track Multiple Objects

abstract: The problem of path planning for autonomously searching and tracking multiple objects is important to reconnaissance, surveillance, and many other data-gathering applications. Due to the inherent competing objectives of searching for new objects while maintaining tracks for found objects, most current approaches rely on multi-objective planning methods, leaving it up to the user to tune parameters to balance between the two objectives, usually based on heuristics or trial and error. In this paper, we introduce $\textit{UniSaT}$ ($\textit{Unified Search and Track}$), a unified-objective formulation for the search and track problem based on Random Finite Sets (RFS). This is done by modeling both the unknown and known objects through a combined generalized labeled multi-Bernoulli (GLMB) filter. For the unseen objects, we can leverage both cardinality and spatial prior distributions, which means $\textit{UniSaT}$ does not rely on knowing the exact count of the expected number of objects in the space. The planner maximizes the mutual information of this unified belief model, creating balanced search and tracking behaviors. We demonstrate our work in a simulated environment and show both qualitative results as well as quantitative improvements over a multi-objective method.


title: Gauss-Bonnet Cosmology: large-temperature behaviour and bounds from Gravitational Waves

abstract: We provide a transparent discussion of the high temperature asymptotic behaviour of Cosmology in a dilaton-Einstein-Gauss-Bonnet (dEGB) scenario of modified gravity with vanishing scalar potential. In particular, we show that it has a clear interpretation in terms of only three attractors (stable critical points) of a set of autonomous differential equations: $w=-\frac{1}{3}$, $w=1$ and $1<w<\frac{7}{3}$, where $w\equiv p/\rho$ is the equation of state, defined as the ratio of the total pressure and the total energy density. All the possible different high-temperature evolution histories of the model are exhausted by only eight paths in the flow of the set of the autonomous differential equations. Our discussion clearly explains why five out of them are characterized by a swift transition of the system toward the attractor, while the remaining three show a more convoluted evolution, where the system follows a meta-stable equation of state at intermediate temperatures before eventually jumping to the real attractor at higher temperatures. Compared to standard Cosmology, the regions of the dEGB parameter space with $w=-\frac{1}{3}$ show a strong enhancement of the expected Gravitational Wave stochastic background produced by the primordial plasma of relativistic particles of the Standard Model. This is due to the very peculiar fact that dEGB allows to have an epoch when the energy density $\rho_{\rm rad}$ of the relativistic plasma dominates the energy of the Universe while at the same time the rate of dilution with $T$ of the total energy density is slower than what usually expected during radiation dominance. This allows to use the bound from BBN to put in dEGB a constraint $T_{\rm RH}\lesssim 10^8 - 10^9$ GeV on the reheating temperature of the Universe $T_{\rm RH}$. Such BBN bound is complementary to late-time constraints from compact binary mergers.


title: Perturbative Frequency Expansion for Nearly Monochromatic Binary Black Holes Detectable with LISA

abstract: The proposed space gravitational wave (GW) detector LISA has potential to detect stellar-mass black hole binaries (BBHs). The majority of the detected BBHs are expected to emit nearly monochromatic GWs, whose frequency evolution will be efficiently described by Taylor expansions. We study the measurability of the associated time derivative coefficients of the frequencies, by extending a recent work based on a simplified Fisher matrix analysis. Additionally, we provide qualitative discussions on how to extract astrophysical information, such as orbital eccentricity and tertiary perturbation, from the observed derivative coefficients.


title: Carnatic Raga Identification System using Rigorous Time-Delay Neural Network

abstract: Large scale machine learning-based Raga identification continues to be a nontrivial issue in the computational aspects behind Carnatic music. Each raga consists of many unique and intrinsic melodic patterns that can be used to easily identify them from others. These ragas can also then be used to cluster songs within the same raga, as well as identify songs in other closely related ragas. In this case, the input sound is analyzed using a combination of steps including using a Discrete Fourier transformation and using Triangular Filtering to create custom bins of possible notes, extracting features from the presence of particular notes or lack thereof. Using a combination of Neural Networks including 1D Convolutional Neural Networks conventionally known as Time-Delay Neural Networks) and Long Short-Term Memory (LSTM), which are a form of Recurrent Neural Networks, the backbone of the classification strategy to build the model can be created. In addition, to help with variations in shruti, a long-time attention-based mechanism will be implemented to determine the relative changes in frequency rather than the absolute differences. This will provide a much more meaningful data point when training audio clips in different shrutis. To evaluate the accuracy of the classifier, a dataset of 676 recordings is used. The songs are distributed across the list of ragas. The goal of this program is to be able to effectively and efficiently label a much wider range of audio clips in more shrutis, ragas, and with more background noise.


title: Topological classification for chiral symmetry with non-equal sublattices

abstract: Chiral symmetry on bipartite lattices with different numbers of $A$-sites and $B$-sites is exceptional in condensed matter, as it gives rise to zero-energy flat bands. Crystalline systems featuring chiral symmetry with non-equal sublattices include Lieb lattices, dice lattices, and particularly Moir\'e systems, where interaction converts the flat bands into fascinating many-body phases. In this work, we present a comprehensive classification theory for chiral symmetry with non-equal sublattices. First, we identify the classifying spaces as Stiefel manifolds and derive the topological classification table. Then, we extend the symmetry by taking $\mathcal{PT}$ symmetry into account, and ultimately obtain three symmetry classes corresponding to complex, real, and quaternionic Stiefel manifolds, respectively. Finally, we apply our theory to clarify the topological invariant for $\mathcal{PT}$-invariant Moir\'e systems and construct physical models with Lieb and dice lattice structures to demonstrate our theory. Our work establishes the theoretical foundation of topological phases protected by chiral symmetries with non-equal sublattices.


title: Does SGD really happen in tiny subspaces?

abstract: Understanding the training dynamics of deep neural networks is challenging due to their high-dimensional nature and intricate loss landscapes. Recent studies have revealed that, along the training trajectory, the gradient approximately aligns with a low-rank top eigenspace of the training loss Hessian, referred to as the dominant subspace. Given this alignment, this paper explores whether neural networks can be trained within the dominant subspace, which, if feasible, could lead to more efficient training methods. Our primary observation is that when the SGD update is projected onto the dominant subspace, the training loss does not decrease further. This suggests that the observed alignment between the gradient and the dominant subspace is spurious. Surprisingly, projecting out the dominant subspace proves to be just as effective as the original update, despite removing the majority of the original update component. Similar observations are made for the large learning rate regime (also known as Edge of Stability) and Sharpness-Aware Minimization. We discuss the main causes and implications of this spurious alignment, shedding light on the intricate dynamics of neural network training.


title: Disentangling Heterogeneous Knowledge Concept Embedding for Cognitive Diagnosis on Untested Knowledge

abstract: Cognitive diagnosis is a fundamental and critical task in learning assessment, which aims to infer students' proficiency on knowledge concepts from their response logs. Current works assume each knowledge concept will certainly be tested and covered by multiple exercises. However, whether online or offline courses, it's hardly feasible to completely cover all knowledge concepts in several exercises. Restricted tests lead to undiscovered knowledge deficits, especially untested knowledge concepts(UKCs). In this paper, we propose a novel \underline{Dis}entangling Heterogeneous \underline{K}nowledge \underline{C}ognitive \underline{D}iagnosis framework on untested knowledge(DisKCD). Specifically, we leverage course grades, exercise questions, and resources to learn the potential representations of students, exercises, and knowledge concepts. In particular, knowledge concepts are disentangled into tested and untested based on the limiting actual exercises. We construct a heterogeneous relation graph network via students, exercises, tested knowledge concepts(TKCs), and UKCs. Then, through a hierarchical heterogeneous message-passing mechanism, the fine-grained relations are incorporated into the embeddings of the entities. Finally, the embeddings will be applied to multiple existing cognitive diagnosis models to infer students' proficiency on UKCs. Experimental results on real-world datasets show that the proposed model can effectively improve the performance of the task of diagnosing students' proficiency on UKCs. Our anonymous code is available at https://anonymous.4open.science/r/DisKCD.


title: Transmission des Ondes \'Electromagn\'etiques

abstract: This book aims to familiarize Electrical Engineering students with exercises and problems related to electromagnetic wave transmission. It includes a brief theoretical introduction to classical electromagnetism formulas to bridge the gap between theory and practical applications. The book focuses on free space, coaxial cables, and waveguides, emphasizing the role of complex permittivity in transmission. It does not cover antennas or the generation of electromagnetic waves. The content is based on courses taught at \'Ecole Polytechnique de Montr\'eal from 1986 to 2017. -- Ce livre vise \`a familiariser les \'etudiants en G\'enie \'Electrique avec des exercices et des probl\`emes concernant la transmission des ondes \'electromagn\'etiques. Il inclut une br\`eve introduction th\'eorique aux formules classiques de l'\'electromagn\'etisme pour combler l'\'ecart entre la th\'eorie et les applications pratiques. Le livre se concentre sur l'espace libre, les c\^ables coaxiaux et les guides d'ondes, en soulignant le r\^ole de la permittivit\'e complexe dans la transmission. Il ne couvre pas les antennes ni la g\'en\'eration des ondes \'electromagn\'etiques. Le contenu est bas\'e sur des cours dispens\'es \`a l'\'Ecole Polytechnique de Montr\'eal de 1986 \`a 2017.


title: PTQ4DiT: Post-training Quantization for Diffusion Transformers

abstract: The recent introduction of Diffusion Transformers (DiTs) has demonstrated exceptional capabilities in image generation by using a different backbone architecture, departing from traditional U-Nets and embracing the scalable nature of transformers. Despite their advanced capabilities, the wide deployment of DiTs, particularly for real-time applications, is currently hampered by considerable computational demands at the inference stage. Post-training Quantization (PTQ) has emerged as a fast and data-efficient solution that can significantly reduce computation and memory footprint by using low-bit weights and activations. However, its applicability to DiTs has not yet been explored and faces non-trivial difficulties due to the unique design of DiTs. In this paper, we propose PTQ4DiT, a specifically designed PTQ method for DiTs. We discover two primary quantization challenges inherent in DiTs, notably the presence of salient channels with extreme magnitudes and the temporal variability in distributions of salient activation over multiple timesteps. To tackle these challenges, we propose Channel-wise Salience Balancing (CSB) and Spearmen's $\rho$-guided Salience Calibration (SSC). CSB leverages the complementarity property of channel magnitudes to redistribute the extremes, alleviating quantization errors for both activations and weights. SSC extends this approach by dynamically adjusting the balanced salience to capture the temporal variations in activation. Additionally, to eliminate extra computational costs caused by PTQ4DiT during inference, we design an offline re-parameterization strategy for DiTs. Experiments demonstrate that our PTQ4DiT successfully quantizes DiTs to 8-bit precision (W8A8) while preserving comparable generation ability and further enables effective quantization to 4-bit weight precision (W4A8) for the first time.


title: Multifractal Analysis of the Sinkhorn Algorithm: Unveiling the Intricate Structure of Optimal Transport Maps

abstract: The Sinkhorn algorithm has emerged as a powerful tool for solving optimal transport problems, finding applications in various domains such as machine learning, image processing, and computational biology. Despite its widespread use, the intricate structure and scaling properties of the coupling matrices generated by the Sinkhorn algorithm remain largely unexplored. In this paper, we delve into the multifractal properties of these coupling matrices, aiming to unravel their complex behavior and shed light on the underlying dynamics of the Sinkhorn algorithm. We prove the existence of the multifractal spectrum and the singularity spectrum for the Sinkhorn coupling matrices. Furthermore, we derive bounds on the generalized dimensions, providing a comprehensive characterization of their scaling properties. Our findings not only deepen our understanding of the Sinkhorn algorithm but also pave the way for novel applications and algorithmic improvements in the realm of optimal transport.


title: 3D reconstruction of a million atoms by multiple-section local-orbital tomography

abstract: There exist two groups of electron microscopy methods that are capable of providing three-dimensional (3D) structural information of an object, i.e., electron tomography and depth sectioning. Electron tomography is capable of resolving atoms in all three dimensions, but the accuracy in atomic positions is low and the object size that can be reconstructed is limited. Depth sectioning methods give high positional accuracy in the imaging plane, but the spatial resolution in the third dimension is low. In this work, electron tomography and depth sectioning are combined to form a method called multiple-section local-orbital tomography, or nLOT in short. The nLOT method provides high spatial resolution and high positional accuracy in all three dimensions. The object size that can be reconstructed is extended to a million atoms. The present method establishes a foundation for the widespread application of atomic electron tomography.


title: Intensity and Texture Correction of Omnidirectional Image Using Camera Images for Indirect Augmented Reality

abstract: Augmented reality (AR) using camera images in mobile devices is becoming popular for tourism promotion. However, obstructions such as tourists appearing in the camera images may cause the camera pose estimation error, resulting in CG misalignment and reduced visibility of the contents. To avoid this problem, Indirect AR (IAR), which does not use real-time camera images, has been proposed. In this method, an omnidirectional image is captured and virtual objects are synthesized on the image in advance. Users can experience AR by viewing a scene extracted from the synthesized omnidirectional image according to the device's sensor. This enables robustness and high visibility. However, if the weather conditions and season in the pre-captured 360 images differs from the current weather conditions and season when AR is experienced, the realism of the AR experience is reduced. To overcome the problem, we propose a method for correcting the intensity and texture of a past omnidirectional image using camera images from mobile devices. We first perform semantic segmentation. We then reproduce the current sky pattern by panoramic image composition and inpainting. For the other areas, we correct the intensity by histogram matching. In experiments, we show the effectiveness of the proposed method using various scenes.


title: Streaming Long Video Understanding with Large Language Models

abstract: This paper presents VideoStreaming, an advanced vision-language large model (VLLM) for video understanding, that capably understands arbitrary-length video with a constant number of video tokens streamingly encoded and adaptively selected. The challenge of video understanding in the vision language area mainly lies in the significant computational burden caused by the great number of tokens extracted from long videos. Previous works rely on sparse sampling or frame compression to reduce tokens. However, such approaches either disregard temporal information in a long time span or sacrifice spatial details, resulting in flawed compression. To address these limitations, our VideoStreaming has two core designs: Memory-Propagated Streaming Encoding and Adaptive Memory Selection. The Memory-Propagated Streaming Encoding architecture segments long videos into short clips and sequentially encodes each clip with a propagated memory. In each iteration, we utilize the encoded results of the preceding clip as historical memory, which is integrated with the current clip to distill a condensed representation that encapsulates the video content up to the current timestamp. After the encoding process, the Adaptive Memory Selection strategy selects a constant number of question-related memories from all the historical memories and feeds them into the LLM to generate informative responses. The question-related selection reduces redundancy within the memories, enabling efficient and precise video understanding. Meanwhile, the disentangled video extraction and reasoning design allows the LLM to answer different questions about a video by directly selecting corresponding memories, without the need to encode the whole video for each question. Our model achieves superior performance and higher efficiency on long video benchmarks, showcasing precise temporal comprehension for detailed question answering.


title: The torsion ideal lattice of the endomorphism ring of an abelian p-group

abstract: The lattice of ideals of the torsion ideal of the endomorphism ring of an abelian p-group is classified by a system of cardinal invariants.


title: Semantic Importance-Aware Communications with Semantic Correction Using Large Language Models

abstract: Semantic communications, a promising approach for agent-human and agent-agent interactions, typically operate at a feature level, lacking true semantic understanding. This paper explores understanding-level semantic communications (ULSC), transforming visual data into human-intelligible semantic content. We employ an image caption neural network (ICNN) to derive semantic representations from visual data, expressed as natural language descriptions. These are further refined using a pre-trained large language model (LLM) for importance quantification and semantic error correction. The subsequent semantic importance-aware communications (SIAC) aim to minimize semantic loss while respecting transmission delay constraints, exemplified through adaptive modulation and coding strategies. At the receiving end, LLM-based semantic error correction is utilized. If visual data recreation is desired, a pre-trained generative artificial intelligence (AI) model can regenerate it using the corrected descriptions. We assess semantic similarities between transmitted and recovered content, demonstrating ULSC's superior ability to convey semantic understanding compared to feature-level semantic communications (FLSC). ULSC's conversion of visual data to natural language facilitates various cognitive tasks, leveraging human knowledge bases. Additionally, this method enhances privacy, as neither original data nor features are directly transmitted.


title: Pessimistic Backward Policy for GFlowNets

abstract: This paper studies Generative Flow Networks (GFlowNets), which learn to sample objects proportionally to a given reward function through the trajectory of state transitions. In this work, we observe that GFlowNets tend to under-exploit the high-reward objects due to training on insufficient number of trajectories, which may lead to a large gap between the estimated flow and the (known) reward value. In response to this challenge, we propose a pessimistic backward policy for GFlowNets (PBP-GFN), which maximizes the observed flow to align closely with the true reward for the object. We extensively evaluate PBP-GFN across eight benchmarks, including hyper-grid environment, bag generation, structured set generation, molecular generation, and four RNA sequence generation tasks. In particular, PBP-GFN enhances the discovery of high-reward objects, maintains the diversity of the objects, and consistently outperforms existing methods.