title: Towards a Generic Representation of Combinatorial Problems for Learning-Based Approaches

abstract: In recent years, there has been a growing interest in using learning-based approaches for solving combinatorial problems, either in an end-to-end manner or in conjunction with traditional optimization algorithms. In both scenarios, the challenge lies in encoding the targeted combinatorial problems into a structure compatible with the learning algorithm. Many existing works have proposed problem-specific representations, often in the form of a graph, to leverage the advantages of \textit{graph neural networks}. However, these approaches lack generality, as the representation cannot be easily transferred from one combinatorial problem to another one. While some attempts have been made to bridge this gap, they still offer a partial generality only. In response to this challenge, this paper advocates for progress toward a fully generic representation of combinatorial problems for learning-based approaches. The approach we propose involves constructing a graph by breaking down any constraint of a combinatorial problem into an abstract syntax tree and expressing relationships (e.g., a variable involved in a constraint) through the edges. Furthermore, we introduce a graph neural network architecture capable of efficiently learning from this representation. The tool provided operates on combinatorial problems expressed in the XCSP3 format, handling all the constraints available in the 2023 mini-track competition. Experimental results on four combinatorial problems demonstrate that our architecture achieves performance comparable to dedicated architectures while maintaining generality. Our code and trained models are publicly available at \url{https://github.com/corail-research/learning-generic-csp}.


title: Multimodal deep learning approach to predicting neurological recovery from coma after cardiac arrest

abstract: This work showcases our team's (The BEEGees) contributions to the 2023 George B. Moody PhysioNet Challenge. The aim was to predict neurological recovery from coma following cardiac arrest using clinical data and time-series such as multi-channel EEG and ECG signals. Our modelling approach is multimodal, based on two-dimensional spectrogram representations derived from numerous EEG channels, alongside the integration of clinical data and features extracted directly from EEG recordings. Our submitted model achieved a Challenge score of $0.53$ on the hidden test set for predictions made $72$ hours after return of spontaneous circulation. Our study shows the efficacy and limitations of employing transfer learning in medical classification. With regard to prospective implementation, our analysis reveals that the performance of the model is strongly linked to the selection of a decision threshold and exhibits strong variability across data splits.


title: Fully discretized Sobolev gradient flow for the Gross-Pitaevskii eigenvalue problem

abstract: For the ground state of the Gross-Pitaevskii (GP) eigenvalue problem, we consider a fully discretized Sobolev gradient flow, which can be regarded as the Riemannian gradient descent on the sphere under a metric induced by a modified $H^1$-norm. We prove its global convergence to a critical point of the discrete GP energy and its local exponential convergence to the ground state of the discrete GP energy. The local exponential convergence rate depends on the eigengap of the discrete GP energy. When the discretization is the classical second-order finite difference in two dimensions, such an eigengap can be further proven to be mesh independent, i.e., it has a uniform positive lower bound, thus the local exponential convergence rate is mesh independent. Numerical experiments with discretization by high order $Q^k$ spectral element methods in two and three dimensions are provided to validate the efficiency of the proposed method.


title: Estimates of the Kolmogorov n-width for nonlinear transformations with application to distributed-parameter control systems

abstract: This paper aims at characterizing the approximability of bounded sets in the range of nonlinear operators in Banach spaces by finite-dimensional linear varieties. In particular, the class of operators we consider includes the endpoint maps of nonlinear distributed-parameter control systems. We describe the relationship between the Kolmogorov n-width of a bounded subset and the width of its image under an essentially nonlinear transformation. We propose explicit estimates of the n-width in the space of images in terms of the affine part of the corresponding operator and the width of its nonlinear perturbation. These $n$-width estimates enable us to describe the reachable sets for infinite-dimensional bilinear control systems, with applications to controlling the Euler-Bernoulli beam using a contraction force and to a single-input Schr\"odinger equation.


title: Foam cobordism and the Sah-Arnoux-Fathi invariant

abstract: This is the first in a series of papers where scissor congruence and K-theoretical invariants are related to cobordism groups of foams in various dimensions. A model example is provided where the cobordism group of weighted one-foams is identified, via the Sah-Arnoux-Fathi invariant, with the first homology of the group of interval exchange automorphisms and with the Zakharevich first K-group of the corresponding assembler. Several variations on this cobordism group are computed as well.


title: FairTargetSim: An Interactive Simulator for Understanding and Explaining the Fairness Effects of Target Variable Definition

abstract: Machine learning requires defining one's target variable for predictions or decisions, a process that can have profound implications on fairness: biases are often encoded in target variable definition itself, before any data collection or training. We present an interactive simulator, FairTargetSim (FTS), that illustrates how target variable definition impacts fairness. FTS is a valuable tool for algorithm developers, researchers, and non-technical stakeholders. FTS uses a case study of algorithmic hiring, using real-world data and user-defined target variables. FTS is open-source and available at: http://tinyurl.com/ftsinterface. The video accompanying this paper is here: http://tinyurl.com/ijcaifts.


title: Matrix Concentration Inequalities for Sensor Selection

abstract: In this work, we address the problem of sensor selection for state estimation via Kalman filtering. We consider a linear time-invariant (LTI) dynamical system subject to process and measurement noise, where the sensors we use to perform state estimation are randomly drawn according to a sampling with replacement policy. Since our selection of sensors is randomly chosen, the estimation error covariance of the Kalman filter is also a stochastic quantity. Fortunately, concentration inequalities (CIs) for the estimation error covariance allow us to gauge the estimation performance we intend to achieve when our sensors are randomly drawn with replacement. To obtain a non-trivial improvement on existing CIs for the estimation error covariance, we first present novel matrix CIs for a sum of independent and identically-distributed (i.i.d.) and positive semi-definite (p.s.d.) random matrices, whose support is finite. Next, we show that our guarantees generalize an existing matrix CI. Also, we show that our generalized guarantees require significantly fewer number of sampled sensors to be applicable. Lastly, we show through a numerical study that our guarantees significantly outperform existing ones in terms of their ability to bound (in the semi-definite sense) the steady-state estimation error covariance of the Kalman filter.


title: Predicting Depression and Anxiety: A Multi-Layer Perceptron for Analyzing the Mental Health Impact of COVID-19

abstract: We introduce a multi-layer perceptron (MLP) called the COVID-19 Depression and Anxiety Predictor (CoDAP) to predict mental health trends, particularly anxiety and depression, during the COVID-19 pandemic. Our method utilizes a comprehensive dataset, which tracked mental health symptoms weekly over ten weeks during the initial COVID-19 wave (April to June 2020) in a diverse cohort of U.S. adults. This period, characterized by a surge in mental health symptoms and conditions, offers a critical context for our analysis. Our focus was to extract and analyze patterns of anxiety and depression through a unique lens of qualitative individual attributes using CoDAP. This model not only predicts patterns of anxiety and depression during the pandemic but also unveils key insights into the interplay of demographic factors, behavioral changes, and social determinants of mental health. These findings contribute to a more nuanced understanding of the complexity of mental health issues in times of global health crises, potentially guiding future early interventions.


title: Content Moderation Justice and Fairness on Social Media: Comparisons Across Different Contexts and Platforms

abstract: Social media users may perceive moderation decisions by the platform differently, which can lead to frustration and dropout. This study investigates users' perceived justice and fairness of online moderation decisions when they are exposed to various illegal versus legal scenarios, retributive versus restorative moderation strategies, and user-moderated versus commercially moderated platforms. We conduct an online experiment on 200 American social media users of Reddit and Twitter. Results show that retributive moderation delivers higher justice and fairness for commercially moderated than for user-moderated platforms in illegal violations; restorative moderation delivers higher fairness for legal violations than illegal ones. We discuss the opportunities for platform policymaking to improve moderation system design.


title: Capital Structure Adjustment Speed and Expected Returns: Examination of Information Asymmetry as a Moderating Role

abstract: Shareholders' expectations of stock returns and fluctuations are constantly changing due to restrictions in financial status and undesirable capital structure, which constrain managers to limit the changes in price trends in order to cover the risk instigated and infused by the unfavorable situation. The present research examines the moderating impact of information asymmetry on the relationship between capital structure adjustment and expected returns. The data from 120 companies approved in the Tehran Stock Exchange were extracted, and a hybrid data regression model was used to test the research hypotheses. Findings indicate that the capital structure adjustment speed correlates with the expected returns. Moreover, the information asymmetry positively affects the relationship between capital structure adjustment speed and expected returns.


title: Deciphering Crypto Twitter

abstract: Cryptocurrency is a fast-moving space, with a continuous influx of new projects every year. However, an increasing number of incidents in the space, such as hacks and security breaches, threaten the growth of the community and the development of technology. This dynamic and often tumultuous landscape is vividly mirrored and shaped by discussions within Crypto Twitter, a key digital arena where investors, enthusiasts, and skeptics converge, revealing real-time sentiments and trends through social media interactions. We present our analysis on a Twitter dataset collected during a formative period of the cryptocurrency landscape. We collected 40 million tweets using cryptocurrency-related keywords and performed a nuanced analysis that involved grouping the tweets by semantic similarity and constructing a tweet and user network. We used sentence-level embeddings and autoencoders to create K-means clusters of tweets and identified six groups of tweets and their topics to examine different cryptocurrency-related interests and the change in sentiment over time. Moreover, we discovered sentiment indicators that point to real-life incidents in the crypto world, such as the FTX incident of November 2022. We also constructed and analyzed different networks of tweets and users in our dataset by considering the reply and quote relationships and analyzed the largest components of each network. Our networks reveal a structure of bot activity in Crypto Twitter and suggest that they can be detected and handled using a network-based approach. Our work sheds light on the potential of social media signals to detect and understand crypto events, benefiting investors, regulators, and curious observers alike, as well as the potential for bot detection in Crypto Twitter using a network-based approach.


title: The Flow Game: Leximin and Leximax Core Imputations

abstract: Recently [Vaz24] gave mechanisms for finding leximin and leximax core imputations for the assignment game and remarked, "Within the area of algorithm design, the "right" technique for solving several types of algorithmic questions was first discovered in the context of matching and later these insights were applied to other problems. We expect a similar phenomenon here." One of the games explicitly mentioned in this context was the flow game of Kalai and Zemel [KZ82]. In this paper, we give strongly polynomial time mechanisms for computing the leximin and leximax core imputations for the flow game, among the set of core imputations that are captured as optimal solutions to the dual LP. We address two versions: 1. The imputations are leximin and leximax with respect to the distance labels of edges. 2. The imputations are leximin and leximax with respect to the product of capacities of edges and their distance labels.


title: QCD at 50: Golden Anniversary, Golden Insights, Golden Opportunities

abstract: The bulk of this paper centers around the tension between confinement and freedom in QCD. I discuss how it can be understood heuristically as a manifestation of self-adhesive glue and how it fits within the larger contexts of energy-time uncertainty and $\textit{real virtuality}$. I discuss the possible emergence of $\textit{treeons}$ as a tangible ingredient of (at least) pure gluon $SU(3)$. I propose $\textit{flux channeling}$ as a method to address that and allied questions about triality flux numerically, and indicate how to implement it for electric and magnetic flux in material systems. That bulk is framed with broad-stroke, necessarily selective sketches of the past and possible future of strong interaction physics. At the end, I've added an expression of gratitude for my formative experience at the Erice school, in 1973.


title: A Preliminary Exploration of YouTubers' Use of Generative-AI in Content Creation

abstract: Content creators increasingly utilize generative artificial intelligence (Gen-AI) on platforms such as YouTube, TikTok, Instagram, and various blogging sites to produce imaginative images, AI-generated videos, and articles using Large Language Models (LLMs). Despite its growing popularity, there remains an underexplored area concerning the specific domains where AI-generated content is being applied, and the methodologies content creators employ with Gen-AI tools during the creation process. This study initially explores this emerging area through a qualitative analysis of 68 YouTube videos demonstrating Gen-AI usage. Our research focuses on identifying the content domains, the variety of tools used, the activities performed, and the nature of the final products generated by Gen-AI in the context of user-generated content.


title: Implementation and characterization of the dice lattice in the electron quantum simulator

abstract: Materials featuring touching points, localized states, and flat bands are of great interest in condensed matter and artificial systems due to their implications in topology, quantum geometry, superconductivity, and interactions. In this theoretical study, we propose the experimental realization of the dice lattice with adjustable parameters by arranging carbon monoxide molecules on a two-dimensional electron system at a (111) copper surface. First, we develop a theoretical framework to obtain the spectral properties within a nearly free electron approximation and then compare them with tight-binding calculations. Our investigation reveals that the high mobility of Shockley state electrons enables an accurate theoretical description of the artificial lattice using a next-nearest-neighbor tight-binding model, resulting in the emergence of a touching point, a quasi-flat band, and localized lattice site behavior in the local density of states. Additionally, we present theoretical results for a long-wavelength low-energy model that accounts for next-nearest-neighbor hopping terms. Furthermore, we theoretically examine the model's behavior under an external magnetic field by employing Peierl's substitution, a commonly used technique in theoretical physics to incorporate magnetic fields into lattice models. Our theoretical findings suggest that, owing to the exceptional electron mobility, the highly degenerate eigenenergy associated with the Aharonov-Bohm caging mechanism may not manifest in the proposed experiment.


title: MATRIX: Multi-Agent Trajectory Generation with Diverse Contexts

abstract: Data-driven methods have great advantages in modeling complicated human behavioral dynamics and dealing with many human-robot interaction applications. However, collecting massive and annotated real-world human datasets has been a laborious task, especially for highly interactive scenarios. On the other hand, algorithmic data generation methods are usually limited by their model capacities, making them unable to offer realistic and diverse data needed by various application users. In this work, we study trajectory-level data generation for multi-human or human-robot interaction scenarios and propose a learning-based automatic trajectory generation model, which we call Multi-Agent TRajectory generation with dIverse conteXts (MATRIX). MATRIX is capable of generating interactive human behaviors in realistic diverse contexts. We achieve this goal by modeling the explicit and interpretable objectives so that MATRIX can generate human motions based on diverse destinations and heterogeneous behaviors. We carried out extensive comparison and ablation studies to illustrate the effectiveness of our approach across various metrics. We also presented experiments that demonstrate the capability of MATRIX to serve as data augmentation for imitation-based motion planning.


title: On the Dirichlet-to-Neumann Map for the $p$-Laplacian on a Metric Measure Space

abstract: In this note, we construct a Dirichlet-to-Neumann map, from a Besov space of functions, to the dual of this class. The Besov spaces are of functions on the boundary of a bounded, locally compact uniform domain equipped with a doubling measure supporting a $p$-Poincar\'e inequality so that this boundary is also equipped with a Radon measure that has a codimensional relationship with the measure on the domain. We construct this map via the following recipe. We show first that solutions to Dirichlet problem for the $p$-Laplacian on the domain with prescribed boundary data in the Besov space induce an operator that lives in the dual of the Besov space. Conversely, we show that there is a solution, in the homogeneous Newton-Sobolev space, to the Neumann problem for the $p$-Laplacian with the Neumann boundary data given by a continuous linear functional belonging to the dual of the Besov space. We also obtain bounds on its operator norm in terms of the norms of trace and extension operators that relate Newton-Sobolev functions on the domain to Besov functions on the boundary.


title: Brownian Motion with a Singular Drift

abstract: We study the effect of a power law drift on Brownian motion in the positive half-line, where the order of the drift at 0 and infinity is different.


title: Orbifold Classifying Spaces and Quotients of complex Tori

abstract: In this paper we characterize the quotients $ X = T/G$ of a complex torus $T$ by the action of a finite group $G$ as the K\"ahler orbifold classifying spaces of the even Euclidean cristallographic groups $\Gamma$, and we prove other similar and stronger characterizations.


title: Sample-Optimal Zero-Violation Safety For Continuous Control

abstract: In this paper, we study the problem of ensuring safety with a few shots of samples for partially unknown systems. We first characterize a fundamental limit when producing safe actions is not possible due to insufficient information or samples. Then, we develop a technique that can generate provably safe actions and recovery behaviors using a minimum number of samples. In the performance analysis, we also establish Nagumos theorem - like results with relaxed assumptions, which is potentially useful in other contexts. Finally, we discuss how the proposed method can be integrated into a policy gradient algorithm to assure safety and stability with a handful of samples without stabilizing initial policies or generative models to probe safe actions.


title: Conventional Superconductivity in the Doped Kagome Superconductor Cs(V0.86Ta0.14)3Sb5 from Vortex Lattice Studies

abstract: A hallmark of unconventional superconductors is their complex electronic phase diagrams where "intertwined orders" of charge-spin-lattice degrees of freedom compete and coexist as in copper oxides and iron pnictides. While the electronic phase diagram of kagome lattice superconductor such as CsV3Sb5 also exhibits complex behavior involving coexisting and competing charge density wave order and superconductivity, much is unclear about the microscopic origin of superconductivity. Here, we study the vortex lattice (VL) in superconducting state of Cs(V0.86Ta0.14)3Sb5, where the Ta-doping suppresses charge order and enhances superconductivity. Using small-angle neutron scattering, a strictly bulk probe, we show that the VL exhibits a strikingly conventional behavior. This includes a triangular VL with a period consistent with 2e-pairing, a field dependent scattering intensity that follows a London model, and a temperature dependence consistent with a uniform superconducting gap expected for s-wave pairing. These results suggest that optimal bulk superconductivity in Cs(V1-xTax)3Sb5 arises from a conventional Bardeen-Cooper-Schrieffer electron-lattice coupling, different from spin fluctuation mediated unconventional copper and iron based superconductors.


title: Intermediate Jacobians and linearizability

abstract: We develop an equivariant version of the formalism of intermediate Jacobian torsor obstructions, and apply it to conic bundles over rational surfaces, quadric surface bundles over $\mathbb P^1$, and Fano threefolds.


title: Texture image retrieval using a classification and contourlet-based features

abstract: In this paper, we propose a new framework for improving Content Based Image Retrieval (CBIR) for texture images. This is achieved by using a new image representation based on the RCT-Plus transform which is a novel variant of the Redundant Contourlet transform that extracts a richer directional information in the image. Moreover, the process of image search is improved through a learning-based approach where the images of the database are classified using an adapted similarity metric to the statistical modeling of the RCT-Plus transform. A query is then first classified to select the best texture class after which the retained class images are ranked to select top ones. By this, we have achieved significant improvements in the retrieval rates compared to previous CBIR schemes.


title: X-ray and molecular dynamics study of the temperature-dependent structure of molten NaF-ZrF4

abstract: The local atomic structure of NaF-ZrF$_4$ (53-47 mol%) molten system and its evolution with temperature are examined with x-ray scattering measurements and compared with $ab-initio$ and Neural Network-based molecular dynamics (NNMD) simulations in the temperature range 515-700 {\deg}C. The machine-learning enhanced NNMD calculations offer improved efficiency while maintaining accuracy at higher distances compared to ab-initio calculations. Looking at the evolution of the Pair Distribution Function with increasing temperature, a fundamental change in the liquid structure within the selected temperature range, accompanied by a slight decrease in overall correlation is revealed. NNMD calculations indicate the co-existence of three different fluorozirconate complexes: [ZrF$_6$]$^{2-}$, [ZrF$_7$]$^{3-}$, and [ZrF$_8$]$^{4-}$, with a temperature-dependent shift in the dominant coordination state towards a 6-coordinated Zr ion at 700{\deg}C. The study also highlights the metastability of different coordination structures, with frequent interconversions between 6 and 7 coordinate states for the fluorozirconate complex from 525 {\deg}C to 700 {\deg}C. Analysis of the Zr-F-Zr angular distribution function reveals the presence of both $"$edge-sharing$"$ and $"$corner-sharing$"$ fluorozirconate complexes with specific bond angles and distances in accord with previous studies, while the next-nearest neighbor cation-cation correlations demonstrate a clear preference for unlike cations as nearest-neighbor pairs, emphasizing non-random arrangement. These findings contribute to a comprehensive understanding of the complex local structure of the molten salt, providing insights into temperature-dependent preferences and correlations within the molten system.


title: Explaining Code with a Purpose: An Integrated Approach for Developing Code Comprehension and Prompting Skills

abstract: Reading, understanding and explaining code have traditionally been important skills for novices learning programming. As large language models (LLMs) become prevalent, these foundational skills are more important than ever given the increasing need to understand and evaluate model-generated code. Brand new skills are also needed, such as the ability to formulate clear prompts that can elicit intended code from an LLM. Thus, there is great interest in integrating pedagogical approaches for the development of both traditional coding competencies and the novel skills required to interact with LLMs. One effective way to develop and assess code comprehension ability is with ``Explain in plain English'' (EiPE) questions, where students succinctly explain the purpose of a fragment of code. However, grading EiPE questions has always been difficult given the subjective nature of evaluating written explanations and this has stifled their uptake. In this paper, we explore a natural synergy between EiPE questions and code-generating LLMs to overcome this limitation. We propose using an LLM to generate code based on students' responses to EiPE questions -- not only enabling EiPE responses to be assessed automatically, but helping students develop essential code comprehension and prompt crafting skills in parallel. We investigate this idea in an introductory programming course and report student success in creating effective prompts for solving EiPE questions. We also examine student perceptions of this activity and how it influences their views on the use of LLMs for aiding and assessing learning.


title: Observation of non-contact Casimir friction

abstract: Quantum mechanics predicts the occurrence of random electromagnetic field fluctuations, or virtual photons, in vacuum. The exchange of virtual photons between two bodies in relative motion could lead to non-contact quantum vacuum friction or Casimir friction. Despite its theoretical significance, the non-contact Casimir frictional force has not been observed and its theoretical predictions have varied widely. In this work, we report the first measurement of the non-contact Casimir frictional force between two moving bodies. By employing two mechanical oscillators with resonant frequencies far lower than those in Lorentz models of electrons in dielectric materials, we have amplified the Casimir frictional force at low relative velocities by several orders of magnitude. We directly measure the non-contact Casimir frictional force between the two oscillators and show its linear dependence on velocity, proving the dissipative nature of Casimir friction. This advancement marks a pivotal contribution to the field of dissipative quantum electrodynamics and enhances our understanding of friction at the nanoscale.


title: Accessing the speed of sound in relativistic ultracentral nucleus-nucleus collisions using the mean transverse momentum

abstract: It has been argued that the speed of sound of the strong interaction at high temperature can be measured using the variation of the mean transverse momentum with the particle multiplicity in ultracentral heavy-ion collisions. We test this correspondence by running hydrodynamic simulations at zero impact parameter with several equations of state, at several colliding energies from 0.2 TeV to 15 TeV per nucleon pair. The correspondence is found to be precise and robust for a smooth, boost-invariant fluid and an ideal detector. We discuss the differences between this ideal setup and an actual experiment. We conclude that the extraction of the speed of sound from data is reliable, and that the main uncertainty comes from our poor knowledge of the distribution of density fluctuations at the early stages of the collision.


title: Spinfoams, $\gamma$-duality and parity violation in primordial gravitational waves

abstract: The Barbero-Immirzi parameter $\gamma$ appears as a coupling constant in the spinfoam dynamics of loop quantum gravity and can be understood as a measure of gravitational parity violation via a duality rotation. We investigate an effective field theory for gravity and a scalar field, with dynamics given by a $\gamma$-dual action obtained via a duality rotation of a parity-non-violating one. The resulting relation between the coupling constants of parity-even and parity-odd higher-curvature terms is determined by $\gamma$, opening the possibility of its measurement in the semiclassical regime. For a choice of $\gamma$-dual effective action, we study cosmic inflation and show that the observation of a primordial tensor polarization, together with the tensor tilt and the tensor-to-scalar ratio, provides a measurement of the Barbero-Immirzi parameter and, therefore, of the scale of discreteness of the quantum geometry of space.


title: Decoupled Data Consistency with Diffusion Purification for Image Restoration

abstract: Diffusion models have recently gained traction as a powerful class of deep generative priors, excelling in a wide range of image restoration tasks due to their exceptional ability to model data distributions. To solve image restoration problems, many existing techniques achieve data consistency by incorporating additional likelihood gradient steps into the reverse sampling process of diffusion models. However, the additional gradient steps pose a challenge for real-world practical applications as they incur a large computational overhead, thereby increasing inference time. They also present additional difficulties when using accelerated diffusion model samplers, as the number of data consistency steps is limited by the number of reverse sampling steps. In this work, we propose a novel diffusion-based image restoration solver that addresses these issues by decoupling the reverse process from the data consistency steps. Our method involves alternating between a reconstruction phase to maintain data consistency and a refinement phase that enforces the prior via diffusion purification. Our approach demonstrates versatility, making it highly adaptable for efficient problem-solving in latent space. Additionally, it reduces the necessity for numerous sampling steps through the integration of consistency models. The efficacy of our approach is validated through comprehensive experiments across various image restoration tasks, including image denoising, deblurring, inpainting, and super-resolution.


title: Direct linearization of the SU(2) anti-self-dual Yang-Mills equation in various spaces

abstract: The paper establishes a direct linearization scheme for the SU(2) anti-self-dual Yang-Mills (ASDYM) equation.The scheme starts from a set of linear integral equations with general measures and plane wave factors. After introducing infinite-dimensional matrices as master functions, we are able to investigate evolution relations and recurrence relations of these functions, which lead us to the unreduced ASDYM equation. It is then reduced to the ASDYM equation in the Euclidean space and two ultrahyperbolic spaces by reductions to meet the reality conditions and gauge conditions, respectively. Special solutions can be obtained by choosing suitable measures.


title: Absence of spurious solutions far from ground truth: A low-rank analysis with high-order losses

abstract: Matrix sensing problems exhibit pervasive non-convexity, plaguing optimization with a proliferation of suboptimal spurious solutions. Avoiding convergence to these critical points poses a major challenge. This work provides new theoretical insights that help demystify the intricacies of the non-convex landscape. In this work, we prove that under certain conditions, critical points sufficiently distant from the ground truth matrix exhibit favorable geometry by being strict saddle points rather than troublesome local minima. Moreover, we introduce the notion of higher-order losses for the matrix sensing problem and show that the incorporation of such losses into the objective function amplifies the negative curvature around those distant critical points. This implies that increasing the complexity of the objective function via high-order losses accelerates the escape from such critical points and acts as a desirable alternative to increasing the complexity of the optimization problem via over-parametrization. By elucidating key characteristics of the non-convex optimization landscape, this work makes progress towards a comprehensive framework for tackling broader machine learning objectives plagued by non-convexity.


title: On the mutual exclusiveness of time and position in quantum physics and the corresponding uncertainty relation for free falling particles

abstract: The uncertainty principle is one of the characteristic properties of quantum theory, where it signals the incompatibility of two types of measurements. In this paper, we argue that measurements of time-of-arrival $T_x$ at position $x$ and position $X_t$ at time $t$ are mutually exclusive for a quantum system, each providing complementary information about the state of that system. For a quantum particle of mass $m$ falling in a uniform gravitational field $g$, we show that the corresponding uncertainty relation can be expressed as $\Delta T_x \Delta X_t \geq \frac{\hbar}{2mg}$. This uncertainty relationship can be taken as evidence of the presence of a form of epistemic incompatibility in the sense that preparing the initial state of the system so as to decrease the measured position uncertainty will lead to an increase in the measured time-of-arrival uncertainty. These findings can be empirically tested in the context of ongoing or forthcoming experiments on measurements of time-of-arrival for free-falling quantum particles.


title: Volume and topology of bounded and closed hyperbolic 3-manifolds, II

abstract: Let $N$ be a compact, orientable hyperbolic 3-manifold whose boundary is a connected totally geodesic surface of genus $2$. If $N$ has Heegaard genus at least $5$, then its volume is greater than $2V_{\rm oct}$, where $V_{\rm oct}=3.66\ldots$ denotes the volume of a regular ideal hyperbolic octahedron in $\mathbb{H}^3$. This improves the lower bound given in our earlier paper ``Volume and topology of bounded and closed hyperbolic $3$-manifolds.'' One ingredient in the improved bound is that in a crucial case, instead of using a single ``muffin'' in $N$ in the sense of Kojima and Miyamoto, we use two disjoint muffins. By combining the result about manifolds with geodesic boundary with the $\log(2k-1)$ theorem and results due to Agol-Culler-Shalen and Shalen-Wagreich, we show that if $M$ is a closed, orientable hyperbolic $3$-manifold with $\mathop{\rm vol} M\le V_{\rm oct}/2$, then $\dim H_1(M;\mathbb{F}_2)\le4$. We also provide new lower bounds for the volumes of closed hyperbolic $3$-manifolds whose cohomology ring over $\mathbb{F}_2$ satisfies certain restrictions; these improve results that were proved in ``Volume and topology$\ldots$.''


title: Test-time Distribution Learning Adapter for Cross-modal Visual Reasoning

abstract: Vision-Language Pre-Trained (VLP) models, such as CLIP, have demonstrated remarkable effectiveness in learning generic visual representations. Several approaches aim to efficiently adapt VLP models to downstream tasks with limited supervision, aiming to leverage the acquired knowledge from VLP models. However, these methods suffer from either introducing biased representations or requiring high computational complexity, which hinders their effectiveness in fine-tuning the CLIP model. Moreover, when a model is trained on data specific to a particular domain, its ability to generalize to uncharted domains diminishes. In this work, we propose Test-Time Distribution LearNing Adapter (TT-DNA) which directly works during the testing period. Specifically, we estimate Gaussian distributions to model visual features of the few-shot support images to capture the knowledge from the support set. The cosine similarity between query image and the feature distribution of support images is used as the prediction of visual adapter. Subsequently, the visual adapter's prediction merges with the original CLIP prediction via a residual connection, resulting in the final prediction. Our extensive experimental results on visual reasoning for human object interaction demonstrate that our proposed TT-DNA outperforms existing state-of-the-art methods by large margins.


title: Ensemble Language Models for Multilingual Sentiment Analysis

abstract: The rapid advancement of social media enables us to analyze user opinions. In recent times, sentiment analysis has shown a prominent research gap in understanding human sentiment based on the content shared on social media. Although sentiment analysis for commonly spoken languages has advanced significantly, low-resource languages like Arabic continue to get little research due to resource limitations. In this study, we explore sentiment analysis on tweet texts from SemEval-17 and the Arabic Sentiment Tweet dataset. Moreover, We investigated four pretrained language models and proposed two ensemble language models. Our findings include monolingual models exhibiting superior performance and ensemble models outperforming the baseline while the majority voting ensemble outperforms the English language.


title: Coupled Dislocations and Fracture dynamics at finite deformation: model derivation, and physical questions

abstract: A continuum mechanical model of coupled dislocation based plasticity and fracture at finite deformation is proposed. Motivating questions and target applications of the model are sketched.

categories: cond-mat.mtrl-sci math-ph math.MP physics.class-ph


title: Higher-order exceptional surface in a pseudo-Hermitian superconducting circuit

abstract: In the last few years, much attention has been paid to exceptional surfaces (ESs) owing to various important physical phenomena and potential applications. However, high-order ESs in pseudo-Hermitian systems have not been reported until now. Here, we study the high-order ES in a pseudo-Hermitian superconducting (SC) circuit system. In our proposal, the SC circuit system is composed of three circularly coupled SC cavities, where the gain and loss are balanced. According to the eigenvalue properties of the pseudo-Hermitian Hamiltonian, we derive the general pseudo-Hermitian conditions for the ternary SC system. In the special pseudo-Hermitian case with parity-time symmetry, all third-order exceptional points (EP3s) of the SC system form a third-order exceptional line in the parameter space. Under the general pseudo-Hermitian conditions, more EP3s are found, and all EP3s are located on a surface, i.e., a third-order exceptional surface is constructed. Moreover, we also investigate the eigenvalues of the pseudo-Hermitian SC circuit around EP3s. Our work opens up a door for exploring high-order ESs and related applications in pseudo-Hermitian systems.


title: Target-constrained Bidirectional Planning for Generation of Target-oriented Proactive Dialogue

abstract: Target-oriented proactive dialogue systems aim to lead conversations from a dialogue context toward a pre-determined target, such as making recommendations on designated items or introducing new specific topics. To this end, it is critical for such dialogue systems to plan reasonable actions to drive the conversation proactively, and meanwhile, to plan appropriate topics to move the conversation forward to the target topic smoothly. In this work, we mainly focus on effective dialogue planning for target-oriented dialogue generation. Inspired by decision-making theories in cognitive science, we propose a novel target-constrained bidirectional planning (TRIP) approach, which plans an appropriate dialogue path by looking ahead and looking back. By formulating the planning as a generation task, our TRIP bidirectionally generates a dialogue path consisting of a sequence of <action, topic> pairs using two Transformer decoders. They are expected to supervise each other and converge on consistent actions and topics by minimizing the decision gap and contrastive generation of targets. Moreover, we propose a target-constrained decoding algorithm with a bidirectional agreement to better control the planning process. Subsequently, we adopt the planned dialogue paths to guide dialogue generation in a pipeline manner, where we explore two variants: prompt-based generation and plan-controlled generation. Extensive experiments are conducted on two challenging dialogue datasets, which are re-purposed for exploring target-oriented dialogue. Our automatic and human evaluations demonstrate that the proposed methods significantly outperform various baseline models.


title: L^2GC:Lorentzian Linear Graph Convolutional Networks for Node Classification

abstract: Linear Graph Convolutional Networks (GCNs) are used to classify the node in the graph data. However, we note that most existing linear GCN models perform neural network operations in Euclidean space, which do not explicitly capture the tree-like hierarchical structure exhibited in real-world datasets that modeled as graphs. In this paper, we attempt to introduce hyperbolic space into linear GCN and propose a novel framework for Lorentzian linear GCN. Specifically, we map the learned features of graph nodes into hyperbolic space, and then perform a Lorentzian linear feature transformation to capture the underlying tree-like structure of data. Experimental results on standard citation networks datasets with semi-supervised learning show that our approach yields new state-of-the-art results of accuracy 74.7$\%$ on Citeseer and 81.3$\%$ on PubMed datasets. Furthermore, we observe that our approach can be trained up to two orders of magnitude faster than other nonlinear GCN models on PubMed dataset. Our code is publicly available at https://github.com/llqy123/LLGC-master.


title: Single-piston quantum engine

abstract: A single-piston quantum engine based on a harmonic oscillator acting as the working fluid is proposed. Using the fact that the interaction between the piston and the oscillator depends on the extent of the oscillator wavefunction, one can control this interaction by modifying the oscillator temperature. By retracting the piston when the interaction is weak (hot oscillator) and returning it to the original position when the coupling is strong (cold oscillator), useful work can be performed assuming the interaction is attractive. The cycle of the engine is simulated numerically using two different powering protocols: bath and measurement. Using the collision model for the baths, the engine is shown to reach a steady state with positive work output.


title: CausalCellSegmenter: Causal Inference inspired Diversified Aggregation Convolution for Pathology Image Segmentation

abstract: Deep learning models have shown promising performance for cell nucleus segmentation in the field of pathology image analysis. However, training a robust model from multiple domains remains a great challenge for cell nucleus segmentation. Additionally, the shortcomings of background noise, highly overlapping between cell nucleus, and blurred edges often lead to poor performance. To address these challenges, we propose a novel framework termed CausalCellSegmenter, which combines Causal Inference Module (CIM) with Diversified Aggregation Convolution (DAC) techniques. The DAC module is designed which incorporates diverse downsampling features through a simple, parameter-free attention module (SimAM), aiming to overcome the problems of false-positive identification and edge blurring. Furthermore, we introduce CIM to leverage sample weighting by directly removing the spurious correlations between features for every input sample and concentrating more on the correlation between features and labels. Extensive experiments on the MoNuSeg-2018 dataset achieves promising results, outperforming other state-of-the-art methods, where the mIoU and DSC scores growing by 3.6% and 2.65%.


title: Federated Learning: Attacks, Defenses, Opportunities, and Challenges

abstract: Using dispersed data and training, federated learning (FL) moves AI capabilities to edge devices or does tasks locally. Many consider FL the start of a new era in AI, yet it is still immature. FL has not garnered the community's trust since its security and privacy implications are controversial. FL's security and privacy concerns must be discovered, analyzed, and recorded before widespread usage and adoption. A solid comprehension of risk variables allows an FL practitioner to construct a secure environment and provide researchers with a clear perspective of potential study fields, making FL the best solution in situations where security and privacy are primary issues. This research aims to deliver a complete overview of FL's security and privacy features to help bridge the gap between current federated AI and broad adoption in the future. In this paper, we present a comprehensive overview of the attack surface to investigate FL's existing challenges and defense measures to evaluate its robustness and reliability. According to our study, security concerns regarding FL are more frequent than privacy issues. Communication bottlenecks, poisoning, and backdoor attacks represent FL's privacy's most significant security threats. In the final part, we detail future research that will assist FL in adapting to real-world settings.


title: Hypothesis testing for homogenous of nodes in $\beta$-models

abstract: The $\beta$-model has been extensively utilized to model degree heterogeneity in networks, wherein each node is assigned a unique parameter. In this article, we consider the hypothesis testing problem that two nodes $i$ and $j$ of a $\beta$-model have the same node parameter. We prove that the null distribution of the proposed statistic converges in distribution to the standard normal distribution. Further, we investigate the homogeneous test for $\beta$-model by combining individual $p$-values to aggregate small effects of multiple tests. Both simulation studies and real-world data examples indicate that the proposed method works well.


title: Implicit Image-to-Image Schrodinger Bridge for CT Super-Resolution and Denoising

abstract: Conditional diffusion models have gained recognition for their effectiveness in image restoration tasks, yet their iterative denoising process, starting from Gaussian noise, often leads to slow inference speeds. As a promising alternative, the Image-to-Image Schr\"odinger Bridge (I2SB) initializes the generative process from corrupted images and integrates training techniques from conditional diffusion models. In this study, we extended the I2SB method by introducing the Implicit Image-to-Image Schrodinger Bridge (I3SB), transitioning its generative process to a non-Markovian process by incorporating corrupted images in each generative step. This enhancement empowers I3SB to generate images with better texture restoration using a small number of generative steps. The proposed method was validated on CT super-resolution and denoising tasks and outperformed existing methods, including the conditional denoising diffusion probabilistic model (cDDPM) and I2SB, in both visual quality and quantitative metrics. These findings underscore the potential of I3SB in improving medical image restoration by providing fast and accurate generative modeling.


title: Reframe Anything: LLM Agent for Open World Video Reframing

abstract: The proliferation of mobile devices and social media has revolutionized content dissemination, with short-form video becoming increasingly prevalent. This shift has introduced the challenge of video reframing to fit various screen aspect ratios, a process that highlights the most compelling parts of a video. Traditionally, video reframing is a manual, time-consuming task requiring professional expertise, which incurs high production costs. A potential solution is to adopt some machine learning models, such as video salient object detection, to automate the process. However, these methods often lack generalizability due to their reliance on specific training data. The advent of powerful large language models (LLMs) open new avenues for AI capabilities. Building on this, we introduce Reframe Any Video Agent (RAVA), a LLM-based agent that leverages visual foundation models and human instructions to restructure visual content for video reframing. RAVA operates in three stages: perception, where it interprets user instructions and video content; planning, where it determines aspect ratios and reframing strategies; and execution, where it invokes the editing tools to produce the final video. Our experiments validate the effectiveness of RAVA in video salient object detection and real-world reframing tasks, demonstrating its potential as a tool for AI-powered video editing.


title: Bit-mask Robust Contrastive Knowledge Distillation for Unsupervised Semantic Hashing

abstract: Unsupervised semantic hashing has emerged as an indispensable technique for fast image search, which aims to convert images into binary hash codes without relying on labels. Recent advancements in the field demonstrate that employing large-scale backbones (e.g., ViT) in unsupervised semantic hashing models can yield substantial improvements. However, the inference delay has become increasingly difficult to overlook. Knowledge distillation provides a means for practical model compression to alleviate this delay. Nevertheless, the prevailing knowledge distillation approaches are not explicitly designed for semantic hashing. They ignore the unique search paradigm of semantic hashing, the inherent necessities of the distillation process, and the property of hash codes. In this paper, we propose an innovative Bit-mask Robust Contrastive knowledge Distillation (BRCD) method, specifically devised for the distillation of semantic hashing models. To ensure the effectiveness of two kinds of search paradigms in the context of semantic hashing, BRCD first aligns the semantic spaces between the teacher and student models through a contrastive knowledge distillation objective. Additionally, to eliminate noisy augmentations and ensure robust optimization, a cluster-based method within the knowledge distillation process is introduced. Furthermore, through a bit-level analysis, we uncover the presence of redundancy bits resulting from the bit independence property. To mitigate these effects, we introduce a bit mask mechanism in our knowledge distillation objective. Finally, extensive experiments not only showcase the noteworthy performance of our BRCD method in comparison to other knowledge distillation methods but also substantiate the generality of our methods across diverse semantic hashing models and backbones. The code for BRCD is available at https://github.com/hly1998/BRCD.


title: Channel Estimation Considerate Precoder Design for Multi-user Massive MIMO-OFDM Systems: The Concept and Fast Algorithms

abstract: The sixth-generation (6G) communication networks target peak data rates exceeding 1Tbps, necessitating base stations (BS) to support up to 100 simultaneous data streams. However, sparse pilot allocation to accommodate such streams poses challenges for users' channel estimation. This paper presents Channel Estimation Considerate Precoding (CECP), where BS precoders prioritize facilitating channel estimation alongside maximizing transmission rate. To address the computational complexity of 6G large-scale multi-input multi-output (MIMO) systems, we propose a computationally-efficient space-time block diagonal channel shortening (ST-BDCS) precoding scheme. By leveraging the sparse Toeplitz property of orthogonal frequency division multiplexing (OFDM) channels, this time-domain precoding design effectively mitigates multi-user interference in the downlink and shortens the effective channel's temporal length. Consequently, users can estimate the channels using sparse pilots. To enable fast implementation, we develop a generalized complex-valued Toeplitz matrix QR decomposition algorithm applicable to various space-time signal processing problems. Simulation results demonstrate that the ST-BDCS precoding method approximates the rate performance of conventional subcarrier-by-subcarrier precoding schemes. However, it offers the advantages of easier channel estimation for users and significantly reduced computational complexity for the BS.


title: Stochastic Geometry Analysis for Distributed RISs-Assisted mmWave Communications

abstract: Millimeter wave (mmWave) has attracted considerable attention due to its wide bandwidth and high frequency. However, it is highly susceptible to blockages, resulting in significant degradation of the coverage and the sum rate. A promising approach is deploying distributed reconfigurable intelligent surfaces (RISs), which can establish extra communication links. In this paper, we investigate the impact of distributed RISs on the coverage probability and the sum rate in mmWave wireless communication systems. Specifically, we first introduce the system model, which includes the blockage, the RIS and the user distribution models, leveraging the Poisson point process. Then, we define the association criterion and derive the conditional coverage probabilities for the two cases of direct association and reflective association through RISs. Finally, we combine the two cases using Campbell's theorem and the total probability theorem to obtain the closed-form expressions for the ergodic coverage probability and the sum rate. Simulation results validate the effectiveness of the proposed analytical approach, demonstrating that the deployment of distributed RISs significantly improves the ergodic coverage probability by 45.4% and the sum rate by over 1.5 times.


title: Hashing Beam Training for Near-Field Communications

abstract: In this paper, we investigate the millimeter-wave (mmWave) near-field beam training problem to find the correct beam direction. In order to address the high complexity and low identification accuracy of existing beam training techniques, we propose an efficient hashing multi-arm beam (HMB) training scheme for the near-field scenario. Specifically, we first design a set of sparse bases based on the polar domain sparsity of the near-field channel. Then, the random hash functions are chosen to construct the near-field multi-arm beam training codebook. Each multi-arm beam codeword is scanned in a time slot until all the predefined codewords are traversed. Finally, the soft decision and voting methods are applied to distinguish the signal from different base stations and obtain correctly aligned beams. Simulation results show that our proposed near-field HMB training method can reduce the beam training overhead to the logarithmic level, and achieve 96.4% identification accuracy of exhaustive beam training. Moreover, we also verify applicability under the far-field scenario.


title: Multisize Dataset Condensation

abstract: While dataset condensation effectively enhances training efficiency, its application in on-device scenarios brings unique challenges. 1) Due to the fluctuating computational resources of these devices, there's a demand for a flexible dataset size that diverges from a predefined size. 2) The limited computational power on devices often prevents additional condensation operations. These two challenges connect to the "subset degradation problem" in traditional dataset condensation: a subset from a larger condensed dataset is often unrepresentative compared to directly condensing the whole dataset to that smaller size. In this paper, we propose Multisize Dataset Condensation (MDC) by compressing N condensation processes into a single condensation process to obtain datasets with multiple sizes. Specifically, we introduce an "adaptive subset loss" on top of the basic condensation loss to mitigate the "subset degradation problem". Our MDC method offers several benefits: 1) No additional condensation process is required; 2) reduced storage requirement by reusing condensed images. Experiments validate our findings on networks including ConvNet, ResNet and DenseNet, and datasets including SVHN, CIFAR-10, CIFAR-100 and ImageNet. For example, we achieved 5.22%-6.40% average accuracy gains on condensing CIFAR-10 to ten images per class. Code is available at: https://github.com/he-y/Multisize-Dataset-Condensation.


title: Sistemas de informaci\'on de salud en contextos extremos: Uso de tel\'efonos m\'oviles para combatir el sida en Uganda

abstract: The HIV/AIDS pandemic is a global issue that has unequally affected several countries. Due to the complexity of this condition and the human drama it represents to those most affected by it, several fields have contributed to solving or at least alleviating this situation, and the information systems (IS) field has not been absent from these efforts. With the importance of antiretroviral therapy (ART) as a starting point, several initiatives in the IS field have focused on ways to improve the adherence and effectiveness of this therapy: mobile phone reminders (for pill intake and appointments), and mobile interfaces between patients and health workers are popular contributions. However, many of these solutions have been difficult to implement or deploy in some countries in the Global South, which are among the most affected by this pandemic. This paper presents one such case. Using a case-study approach with an extreme-case selection technique, the paper studies an m-health system for HIV patients in the Kalangala region of Uganda. Using Heeks' design-reality gap model for data analysis, the paper shows that the rich interaction between social context and technology should be considered a central concern when designing or deploying such systems.


title: Steering a Fleet: Adaptation for Large-Scale, Workflow-Based Experiments

abstract: Experimental science is increasingly driven by instruments that produce vast volumes of data and thus a need to manage, compute, describe, and index this data. High performance and distributed computing provide the means of addressing the computing needs; however, in practice, the variety of actions required and the distributed set of resources involved, requires sophisticated "flows" defining the steps to be performed on data. As each scan or measurement is performed by an instrument, a new instance of the flow is initiated resulting in a "fleet" of concurrently running flows, with the overall goal to process all the data collected during a potentially long-running experiment. During the course of the experiment, each flow may need to adapt its execution due to changes in the environment, such as computational or storage resource availability, or based on the progress of the fleet as a whole such as completion or discovery of an intermediate result leading to a change in subsequent flow's behavior. We introduce a cloud-based decision engine, Braid, which flows consult during execution to query their run-time environment and coordinate with other flows within their fleet. Braid accepts streams of measurements taken from the run-time environment or from within flow runs which can then be statistically aggregated and compared to other streams to determine a strategy to guide flow execution. For example, queue lengths in execution environments can be used to direct a flow to run computations in one environment or another, or experiment progress as measured by individual flows can be aggregated to determine the progress and subsequent direction of the flows within a fleet. We describe Braid, its interface, implementation and performance characteristics. We further show through examples and experience modifying an existing scientific flow how Braid is used to make adaptable flows.


title: Decomposition of Persistent Homology and Spectral Sequences

abstract: We study the relation between the persistent homology and the spectral sequence of a filtered chain complex over a field. Our method is based on a decomposition of the persistent homology. We demonstrate that, under fairly general assumptions, these two algebraic structures capture the same information from the filtered chain complex.


title: Generalization of Graph Neural Networks through the Lens of Homomorphism

abstract: Despite the celebrated popularity of Graph Neural Networks (GNNs) across numerous applications, the ability of GNNs to generalize remains less explored. In this work, we propose to study the generalization of GNNs through a novel perspective - analyzing the entropy of graph homomorphism. By linking graph homomorphism with information-theoretic measures, we derive generalization bounds for both graph and node classifications. These bounds are capable of capturing subtleties inherent in various graph structures, including but not limited to paths, cycles and cliques. This enables a data-dependent generalization analysis with robust theoretical guarantees. To shed light on the generality of of our proposed bounds, we present a unifying framework that can characterize a broad spectrum of GNN models through the lens of graph homomorphism. We validate the practical applicability of our theoretical findings by showing the alignment between the proposed bounds and the empirically observed generalization gaps over both real-world and synthetic datasets.


title: Local Vertex Colouring Graph Neural Networks

abstract: In recent years, there has been a significant amount of research focused on expanding the expressivity of Graph Neural Networks (GNNs) beyond the Weisfeiler-Lehman (1-WL) framework. While many of these studies have yielded advancements in expressivity, they have frequently come at the expense of decreased efficiency or have been restricted to specific types of graphs. In this study, we investigate the expressivity of GNNs from the perspective of graph search. Specifically, we propose a new vertex colouring scheme and demonstrate that classical search algorithms can efficiently compute graph representations that extend beyond the 1-WL. We show the colouring scheme inherits useful properties from graph search that can help solve problems like graph biconnectivity. Furthermore, we show that under certain conditions, the expressivity of GNNs increases hierarchically with the radius of the search neighbourhood. To further investigate the proposed scheme, we develop a new type of GNN based on two search strategies, breadth-first search and depth-first search, highlighting the graph properties they can capture on top of 1-WL. Our code is available at https://github.com/seanli3/lvc.


title: A remark on the first eigenvalue of the p-Laplacian on compact submanifolds in the unit sphere

abstract: An integral inequality for the singular p-laplacian is established for 3/2<p<2. As consequence, lower bounds for the first eigenvalue of the p-laplacian are obtained for minimal submanifolds and prescribed scalar curvature submanifolds in the unit sphere.


title: FrameQuant: Flexible Low-Bit Quantization for Transformers

abstract: Transformers are the backbone of powerful foundation models for many Vision and Natural Language Processing tasks. But their compute and memory/storage footprint is large, and so, serving such models is expensive often requiring high-end hardware. To mitigate this difficulty, Post-Training Quantization seeks to modify a pre-trained model and quantize it to eight bits or lower, significantly boosting compute/memory/latency efficiency. Such models have been successfully quantized to four bits with some performance loss. In this work, we outline a simple scheme to quantize Transformer-based models to just two bits (plus some overhead) with only a small drop in accuracy. Key to our formulation is a concept borrowed from Harmonic analysis called Fusion Frames. Our main finding is that the quantization must take place not in the original weight space, but instead in the Fusion Frame representations. If quantization is interpreted as the addition of noise, our casting of the problem allows invoking an extensive body of known consistent recovery and noise robustness guarantees. Further, if desired, de-noising filters are known in closed form. We show empirically, via a variety of experiments, that (almost) two-bit quantization for Transformer models promises sizable efficiency gains.


title: Ergodic properties of one-dimensional incommensurate bilayer materials

abstract: We review ergodic properties of one-dimensional incommensurate bilayer materials, especially the convergence of the density of states in the large-volume limit, from the perspective of the theory of ergodic Schr\"odinger operators. More precisely, we first provide a short introduction to ergodic Schr\"odinger operators as a unifying concept in spectral theory at a level accessible for nonspecialists. We then present two natural tight-binding models of incommensurate bilayer materials in one dimension and prove convergence of their density of states measures in the large volume limit using ideas from the theory of ergodic Schr\"odinger operators.


title: pETNNs: Partial Evolutionary Tensor Neural Networks for Solving Time-dependent Partial Differential Equations

abstract: We present partial evolutionary tensor neural networks (pETNNs), a novel framework for solving time-dependent partial differential equations with both of high accuracy and remarkable extrapolation. Our proposed architecture leverages the inherent accuracy of tensor neural networks, while incorporating evolutionary parameters that enable remarkable extrapolation capabilities. By adopting innovative parameter update strategies, the pETNNs achieve a significant reduction in computational cost while maintaining precision and robustness. Notably, the pETNNs enhance the accuracy of conventional evolutional deep neural networks and empowers computational abilities to address high-dimensional problems. Numerical experiments demonstrate the superior performance of the pETNNs in solving time-dependent complex equations, including the Navier-Stokes equations, high-dimensional heat equation, high-dimensional transport equation and Korteweg-de Vries type equation.


title: van Hove Singularity-Driven Emergence of Multiple Flat Bands in Kagome Superconductors

abstract: The newly discovered Kagome superconductors AV$_3$Sb$_5$ (A=K, Rb and Cs) continue to bring surprises in generating unusual phenomena and physical properties, including anomalous Hall effect, unconventional charge density wave, electronic nematicity and time-reversal symmetry breaking. Here we report an unexpected emergence of multiple flat bands in the AV$_3$Sb$_5$ superconductors. By performing high-resolution angle-resolved photoemission (ARPES) measurements, we observed four branches of flat bands that span over the entire momentum space. The appearance of the flat bands is not anticipated from the band structure calculations and cannot be accounted for by the known mechanisms of flat band generation. It is intimately related to the evolution of van Hove singularities. It is for the first time to observe such emergence of multiple flat bands in solid materials. Our findings provide new insights in revealing the underlying mechanism that governs the unusual behaviors in the Kagome superconductors. They also provide a new pathway in producing flat bands and set a platform to study the flat bands related physics.


title: Towards Generalizable and Interpretable Motion Prediction: A Deep Variational Bayes Approach

abstract: Estimating the potential behavior of the surrounding human-driven vehicles is crucial for the safety of autonomous vehicles in a mixed traffic flow. Recent state-of-the-art achieved accurate prediction using deep neural networks. However, these end-to-end models are usually black boxes with weak interpretability and generalizability. This paper proposes the Goal-based Neural Variational Agent (GNeVA), an interpretable generative model for motion prediction with robust generalizability to out-of-distribution cases. For interpretability, the model achieves target-driven motion prediction by estimating the spatial distribution of long-term destinations with a variational mixture of Gaussians. We identify a causal structure among maps and agents' histories and derive a variational posterior to enhance generalizability. Experiments on motion prediction datasets validate that the fitted model can be interpretable and generalizable and can achieve comparable performance to state-of-the-art results.


title: Learning the irreversible progression trajectory of Alzheimer's disease

abstract: Alzheimer's disease (AD) is a progressive and irreversible brain disorder that unfolds over the course of 30 years. Therefore, it is critical to capture the disease progression in an early stage such that intervention can be applied before the onset of symptoms. Machine learning (ML) models have been shown effective in predicting the onset of AD. Yet for subjects with follow-up visits, existing techniques for AD classification only aim for accurate group assignment, where the monotonically increasing risk across follow-up visits is usually ignored. Resulted fluctuating risk scores across visits violate the irreversibility of AD, hampering the trustworthiness of models and also providing little value to understanding the disease progression. To address this issue, we propose a novel regularization approach to predict AD longitudinally. Our technique aims to maintain the expected monotonicity of increasing disease risk during progression while preserving expressiveness. Specifically, we introduce a monotonicity constraint that encourages the model to predict disease risk in a consistent and ordered manner across follow-up visits. We evaluate our method using the longitudinal structural MRI and amyloid-PET imaging data from the Alzheimer's Disease Neuroimaging Initiative (ADNI). Our model outperforms existing techniques in capturing the progressiveness of disease risk, and at the same time preserves prediction accuracy.


title: Towards In-Vehicle Multi-Task Facial Attribute Recognition: Investigating Synthetic Data and Vision Foundation Models

abstract: In the burgeoning field of intelligent transportation systems, enhancing vehicle-driver interaction through facial attribute recognition, such as facial expression, eye gaze, age, etc., is of paramount importance for safety, personalization, and overall user experience. However, the scarcity of comprehensive large-scale, real-world datasets poses a significant challenge for training robust multi-task models. Existing literature often overlooks the potential of synthetic datasets and the comparative efficacy of state-of-the-art vision foundation models in such constrained settings. This paper addresses these gaps by investigating the utility of synthetic datasets for training complex multi-task models that recognize facial attributes of passengers of a vehicle, such as gaze plane, age, and facial expression. Utilizing transfer learning techniques with both pre-trained Vision Transformer (ViT) and Residual Network (ResNet) models, we explore various training and adaptation methods to optimize performance, particularly when data availability is limited. We provide extensive post-evaluation analysis, investigating the effects of synthetic data distributions on model performance in in-distribution data and out-of-distribution inference. Our study unveils counter-intuitive findings, notably the superior performance of ResNet over ViTs in our specific multi-task context, which is attributed to the mismatch in model complexity relative to task complexity. Our results highlight the challenges and opportunities for enhancing the use of synthetic data and vision foundation models in practical applications.


title: Knowledge Distillation of Convolutional Neural Networks through Feature Map Transformation using Decision Trees

abstract: The interpretation of reasoning by Deep Neural Networks (DNN) is still challenging due to their perceived black-box nature. Therefore, deploying DNNs in several real-world tasks is restricted by the lack of transparency of these models. We propose a distillation approach by extracting features from the final layer of the convolutional neural network (CNN) to address insights to its reasoning. The feature maps in the final layer of a CNN are transformed into a one-dimensional feature vector using a fully connected layer. Subsequently, the extracted features are used to train a decision tree to achieve the best accuracy under constraints of depth and nodes. We use the medical images of dermaMNIST, octMNIST, and pneumoniaMNIST from the medical MNIST datasets to demonstrate our proposed work. We observed that performance of the decision tree is as good as a CNN with minimum complexity. The results encourage interpreting decisions made by the CNNs using decision trees.


title: Diffusion Models Trained with Large Data Are Transferable Visual Models

abstract: We show that, simply initializing image understanding models using a pre-trained UNet (or transformer) of diffusion models, it is possible to achieve remarkable transferable performance on fundamental vision perception tasks using a moderate amount of target data (even synthetic data only), including monocular depth, surface normal, image segmentation, matting, human pose estimation, among virtually many others. Previous works have adapted diffusion models for various perception tasks, often reformulating these tasks as generation processes to align with the diffusion process. In sharp contrast, we demonstrate that fine-tuning these models with minimal adjustments can be a more effective alternative, offering the advantages of being embarrassingly simple and significantly faster. As the backbone network of Stable Diffusion models is trained on giant datasets comprising billions of images, we observe very robust generalization capabilities of the diffusion backbone. Experimental results showcase the remarkable transferability of the backbone of diffusion models across diverse tasks and real-world datasets.


title: Fish-inspired tracking of underwater turbulent plumes

abstract: Autonomous ocean-exploring vehicles have begun to take advantage of onboard sensor measurements of water properties such as salinity and temperature to locate oceanic features in real time. Such targeted sampling strategies enable more rapid study of ocean environments by actively steering towards areas of high scientific value. Inspired by the ability of aquatic animals to navigate via flow sensing, this work investigates hydrodynamic cues for accomplishing targeted sampling using a palm-sized robotic swimmer. As proof-of-concept analogy for tracking hydrothermal vent plumes in the ocean, the robot is tasked with locating the center of turbulent jet flows in a 13,000-liter water tank using data from onboard pressure sensors. To learn a navigation strategy, we first implemented Reinforcement Learning (RL) on a simulated version of the robot navigating in proximity to turbulent jets. After training, the RL algorithm discovered an effective strategy for locating the jets by following transverse velocity gradients sensed by pressure sensors located on opposite sides of the robot. When implemented on the physical robot, this gradient following strategy enabled the robot to successfully locate the turbulent plumes at more than twice the rate of random searching. Additionally, we found that navigation performance improved as the distance between the pressure sensors increased, which can inform the design of distributed flow sensors in ocean robots. Our results demonstrate the effectiveness and limits of flow-based navigation for autonomously locating hydrodynamic features of interest.


title: Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?

abstract: Neural Radiance Field (NeRF) has achieved superior performance for novel view synthesis by modeling the scene with a Multi-Layer Perception (MLP) and a volume rendering procedure, however, when fewer known views are given (i.e., few-shot view synthesis), the model is prone to overfit the given views. To handle this issue, previous efforts have been made towards leveraging learned priors or introducing additional regularizations. In contrast, in this paper, we for the first time provide an orthogonal method from the perspective of network structure. Given the observation that trivially reducing the number of model parameters alleviates the overfitting issue, but at the cost of missing details, we propose the multi-input MLP (mi-MLP) that incorporates the inputs (i.e., location and viewing direction) of the vanilla MLP into each layer to prevent the overfitting issue without harming detailed synthesis. To further reduce the artifacts, we propose to model colors and volume density separately and present two regularization terms. Extensive experiments on multiple datasets demonstrate that: 1) although the proposed mi-MLP is easy to implement, it is surprisingly effective as it boosts the PSNR of the baseline from $14.73$ to $24.23$. 2) the overall framework achieves state-of-the-art results on a wide range of benchmarks. We will release the code upon publication.


title: Enhancing 3D Object Detection with 2D Detection-Guided Query Anchors

abstract: Multi-camera-based 3D object detection has made notable progress in the past several years. However, we observe that there are cases (e.g. faraway regions) in which popular 2D object detectors are more reliable than state-of-the-art 3D detectors. In this paper, to improve the performance of query-based 3D object detectors, we present a novel query generating approach termed QAF2D, which infers 3D query anchors from 2D detection results. A 2D bounding box of an object in an image is lifted to a set of 3D anchors by associating each sampled point within the box with depth, yaw angle, and size candidates. Then, the validity of each 3D anchor is verified by comparing its projection in the image with its corresponding 2D box, and only valid anchors are kept and used to construct queries. The class information of the 2D bounding box associated with each query is also utilized to match the predicted boxes with ground truth for the set-based loss. The image feature extraction backbone is shared between the 3D detector and 2D detector by adding a small number of prompt parameters. We integrate QAF2D into three popular query-based 3D object detectors and carry out comprehensive evaluations on the nuScenes dataset. The largest improvement that QAF2D can bring about on the nuScenes validation subset is $2.3\%$ NDS and $2.7\%$ mAP. Code is available at https://github.com/nullmax-vision/QAF2D.


title: SecureRights: A Blockchain-Powered Trusted DRM Framework for Robust Protection and Asserting Digital Rights

abstract: In the dynamic realm of digital content, safeguarding intellectual property rights poses critical challenges. This paper presents "SecureRights," an innovative Blockchain-based Trusted Digital Rights Management (DRM) framework. It strengthens the defence against unauthorized use and streamlines the claim of digital rights. Utilizing blockchain, digital watermarking, perceptual hashing, Quick Response (QR) codes, and the Interplanetary File System (IPFS), SecureRights securely stores watermark information on the blockchain with timestamp authentication. Incorporating perceptual hashing generates robust hash tokens based on image structure. The addition of QR codes enhances the watermarking, offering a comprehensive solution for resilient intellectual property rights protection. Rigorous evaluations affirm SecureRights' resilience against various attacks, establishing its efficacy in safeguarding digital content and simplifying rightful ownership assertion.


title: RepoHyper: Better Context Retrieval Is All You Need for Repository-Level Code Completion

abstract: Code Large Language Models (CodeLLMs) have demonstrated impressive proficiency in code completion tasks. However, they often fall short of fully understanding the extensive context of a project repository, such as the intricacies of relevant files and class hierarchies, which can result in less precise completions. To overcome these limitations, we present \tool, a multifaceted framework designed to address the complex challenges associated with repository-level code completion. Central to \tool is the {\em Repo-level Semantic Graph} (RSG), a novel semantic graph structure that encapsulates the vast context of code repositories. Furthermore, RepoHyper leverages \textit{Expand and Refine} retrieval method, including a graph expansion and a link prediction algorithm applied to the RSG, enabling the effective retrieval and prioritization of relevant code snippets. Our evaluations show that \tool markedly outperforms existing techniques in repository-level code completion, showcasing enhanced accuracy across various datasets when compared to several strong baselines. Our implementation of RepoHyper can be found at~\url{https://github.com/FSoft-AI4Code/RepoHyper}.


title: A method for constructing graphs with the same resistance spectrum

abstract: Let $G=(V(G),E(G))$ be a graph with vertex set $V(G)$ and edge set $E(G)$. The resistance distance $R_G(x,y)$ between two vertices $x,y$ of $G$ is defined to be the effective resistance between the two vertices in the corresponding electrical network in which each edge of $G$ is replaced by a unit resistor. The resistance spectrum $\mathrm{RS}(G)$ of a graph $G$ is the multiset of the resistance distances of all pairs of vertices in the graph. This paper presents a method for constructing graphs with the same resistance spectrum. It is obtained that for any positive integer $k$, there exist at least $2^k$ graphs with the same resistance spectrum. Furthermore, it is shown that for $n \geq 10$, there are at least $2(n-9) p(n-9)$ pairs of graphs of order $n$ with the same resistance spectrum, where $p(n-9)$ is the number of partitions of the integer $n-9$.


title: Can LLM Substitute Human Labeling? A Case Study of Fine-grained Chinese Address Entity Recognition Dataset for UAV Delivery

abstract: We present CNER-UAV, a fine-grained \textbf{C}hinese \textbf{N}ame \textbf{E}ntity \textbf{R}ecognition dataset specifically designed for the task of address resolution in \textbf{U}nmanned \textbf{A}erial \textbf{V}ehicle delivery systems. The dataset encompasses a diverse range of five categories, enabling comprehensive training and evaluation of NER models. To construct this dataset, we sourced the data from a real-world UAV delivery system and conducted a rigorous data cleaning and desensitization process to ensure privacy and data integrity. The resulting dataset, consisting of around 12,000 annotated samples, underwent human experts and \textbf{L}arge \textbf{L}anguage \textbf{M}odel annotation. We evaluated classical NER models on our dataset and provided in-depth analysis. The dataset and models are publicly available at \url{https://github.com/zhhvvv/CNER-UAV}.


title: VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models

abstract: The arrival of Sora marks a new era for text-to-video diffusion models, bringing significant advancements in video generation and potential applications. However, Sora, along with other text-to-video diffusion models, is highly reliant on prompts, and there is no publicly available dataset that features a study of text-to-video prompts. In this paper, we introduce VidProM, the first large-scale dataset comprising 1.67 Million unique text-to-Video Prompts from real users. Additionally, this dataset includes 6.69 million videos generated by four state-of-the-art diffusion models, alongside some related data. We initially discuss the curation of this large-scale dataset, a process that is both time-consuming and costly. Subsequently, we underscore the need for a new prompt dataset specifically designed for text-to-video generation by illustrating how VidProM differs from DiffusionDB, a large-scale prompt-gallery dataset for image generation. Our extensive and diverse dataset also opens up many exciting new research areas. For instance, we suggest exploring text-to-video prompt engineering, efficient video generation, and video copy detection for diffusion models to develop better, more efficient, and safer models. The project (including the collected dataset VidProM and related code) is publicly available at https://vidprom.github.io under the CC-BY-NC 4.0 License.


title: Investigating $D^0$ meson production in $p-$Pb collisions at 5.02 TeV with a multi-phase transport model

abstract: We study the production of $D^0$ meson in $p$+$p$ and $p-$Pb collisions using the improved AMPT model considering both coalescence and independent fragmentation of charm quarks after the Cronin broadening are included. After a detailed discussion of the improvements implemented in the AMPT model for heavy quark production, we show that the modified AMPT model can provide good description of $D^0$ meson spectra in $p-$Pb collisions, the $Q_{\rm pPb}$ data at different centrality and $R_{\rm pPb}$ data in both mid- and forward (backward) rapidities. We also studied the effects of nuclear shadowing and parton cascade on the rapidity dependence of $D^{0}$ meson production and $R_{\rm pPb}$. Our results indicate that having the same strength of the Cronin (i.e $\delta$ value) obtained from the mid-rapidity data leads to a considerable overestimation of the $D^0$ meson spectra and $R_{\rm pPb}$ data at high $p_{T}$ in the backward rapidity. As a result, the $\delta$ is determined via a $\chi^2$ fitting of the $R_{\rm pPb}$ data across various rapidities. This work lays the foundation for a better understanding of cold-nuclear-matter (CNM) effects in relativistic heavy-ion collisions.


title: Automatic design optimization of preference-based subjective evaluation with online learning in crowdsourcing environment

abstract: A preference-based subjective evaluation is a key method for evaluating generative media reliably. However, its huge combinations of pairs prohibit it from being applied to large-scale evaluation using crowdsourcing. To address this issue, we propose an automatic optimization method for preference-based subjective evaluation in terms of pair combination selections and allocation of evaluation volumes with online learning in a crowdsourcing environment. We use a preference-based online learning method based on a sorting algorithm to identify the total order of evaluation targets with minimum sample volumes. Our online learning algorithm supports parallel and asynchronous execution under fixed-budget conditions required for crowdsourcing. Our experiment on preference-based subjective evaluation of synthetic speech shows that our method successfully optimizes the test by reducing pair combinations from 351 to 83 and allocating optimal evaluation volumes for each pair ranging from 30 to 663 without compromising evaluation accuracies and wasting budget allocations.


title: An asymmetric four-bend S-chicane compressor immune to coherent synchrotron radiation effects

abstract: The most significant advances in x-ray free electron lasers (FELs) have been driven by the development of ingenious bunch compressors and high-brightness sources in the last several decades. Coherent synchrotron radiation (CSR) is considered a disruptive effect that hinders the reach of design targets, and its control is of essential importance for bunch compression to avoid beam phase-space quality degradation, especially transverse emittance dilution. Herein, we demonstrate a design to cancel the CSR-driven emittance excitation by arranging four adjacent bends into an asymmetric S-chicane without any use of additional components. The CSR-induced emittance growth of the proposed chicane is found to be drastically reduced by nearly one order of magnitude compared with the nominal symmetric C-chicane by particle tracking simulation. This breakthrough opens the door for the bunch compressors to meet the ever-increasing demands of future accelerator applications, especially important in the field of FELs.


title: Coherent Temporal Synthesis for Incremental Action Segmentation

abstract: Data replay is a successful incremental learning technique for images. It prevents catastrophic forgetting by keeping a reservoir of previous data, original or synthesized, to ensure the model retains past knowledge while adapting to novel concepts. However, its application in the video domain is rudimentary, as it simply stores frame exemplars for action recognition. This paper presents the first exploration of video data replay techniques for incremental action segmentation, focusing on action temporal modeling. We propose a Temporally Coherent Action (TCA) model, which represents actions using a generative model instead of storing individual frames. The integration of a conditioning variable that captures temporal coherence allows our model to understand the evolution of action features over time. Therefore, action segments generated by TCA for replay are diverse and temporally coherent. In a 10-task incremental setup on the Breakfast dataset, our approach achieves significant increases in accuracy for up to 22% compared to the baselines.


title: Generative LSTM Models and Asset Hierarchy Creation in Industrial Facilities

abstract: In the evolving field of maintenance and reliability engineering, the organization of equipment into hierarchical structures presents both a challenge and a necessity, directly impacting the operational integrity of industrial facilities. This paper introduces an innovative approach employing machine learning, specifically Long Short-Term Memory (LSTM) models, to automate and enhance the creation and management of these hierarchies. By adapting techniques commonly used in natural language processing, the study explores the potential of LSTM models to interpret and predict relationships within equipment tags, offering a novel perspective on understanding facility design. This methodology involved character-wise tokenization of asset tags from approximately 29,000 entries across 50 upstream oil and gas facilities, followed by modeling these sequences using an LSTM-based recurrent neural network. The model's architecture capitalizes on LSTM's ability to learn long-term dependencies, facilitating the prediction of hierarchical relationships and contextual understanding of equipment tags.


title: Universal Debiased Editing on Foundation Models for Fair Medical Image Classification

abstract: In the era of Foundation Models' (FMs) rising prominence in AI, our study addresses the challenge of biases in medical images while using FM API, particularly spurious correlations between pixels and sensitive attributes. Traditional methods for bias mitigation face limitations due to the restricted access to web-hosted FMs and difficulties in addressing the underlying bias encoded within the FM API. We propose an U(niversal) D(ebiased) E(diting) strategy, termed UDE, which generates UDE noise to mask such spurious correlation. UDE is capable of mitigating bias both within the FM API embedding and the images themselves. Furthermore, UDE is suitable for both white-box and black-box FM APIs, where we introduced G(reedy) (Z)eroth-O(rder) (GeZO) optimization for it when the gradient is inaccessible in black-box APIs. Our whole pipeline enables fairness-aware image editing that can be applied across various medical contexts without requiring direct model manipulation or significant computational resources. Our empirical results demonstrate the method's effectiveness in maintaining fairness and utility across different patient groups and diseases. In the era of AI-driven medicine, this work contributes to making healthcare diagnostics more equitable, showcasing a practical solution for bias mitigation in pre-trained image FMs.


title: Connection Laplacian on discrete tori with converging property

abstract: This paper presents a comprehensive analysis of the spectral properties of the connection Laplacian for both real and discrete tori. We introduce novel methods to examine these eigenvalues by employing parallel orthonormal basis in the pullback bundle on universal covering spaces. Our main results reveal that the eigenvalues of the connection Laplacian on a real torus can be expressed in terms of standard Laplacian eigenvalues, with a unique twist encapsulated in the torsion matrix. This connection is further investigated in the context of discrete tori, where we demonstrate similar results. A significant portion of the paper is dedicated to exploring the convergence properties of a family of discrete tori towards a real torus. We extend previous findings on the spectrum of the standard Laplacian to include the connection Laplacian, revealing that the rescaled eigenvalues of discrete tori converge to those of the real torus. Furthermore, our analysis of the discrete torus occurs within a broader context, where it is not constrained to being a product of cyclic groups. Additionally, we delve into the theta functions associated with these structures, providing a detailed analysis of their behavior and convergence. The paper culminates in a study of the regularized log-determinant of the connection Laplacian and the converging results of it. We derive formulae for both real and discrete tori, emphasizing their dependence on the spectral zeta function and theta functions.


title: Global sensitivity analysis in Monte Carlo radiation transport

abstract: We consider Global Sensitivity Analysis for Monte Carlo radiation transport applications. GSA is usually combined with Uncertainty Quantification, where the latter quantifies the variability of a model output in the presence of uncertain inputs and the former attributes this variability to the inputs. The additional noise inherent to MC RT solvers due to the finite number of particle histories presents an additional challenge to GSA and UQ, which are well-established for deterministic solvers. In this contribution, we apply variance deconvolution to the Saltelli method to address MC RT solver noise without having to over-resolve the MC RT simulation.


title: Textureless Object Recognition: An Edge-based Approach

abstract: Textureless object recognition has become a significant task in Computer Vision with the advent of Robotics and its applications in manufacturing sector. It has been challenging to obtain good accuracy in real time because of its lack of discriminative features and reflectance properties which makes the techniques for textured object recognition insufficient for textureless objects. A lot of work has been done in the last 20 years, especially in the recent 5 years after the TLess and other textureless dataset were introduced. In this project, by applying image processing techniques we created a robust augmented dataset from initial imbalanced smaller dataset. We extracted edge features, feature combinations and RGB images enhanced with feature/feature combinations to create 15 datasets, each with a size of ~340,000. We then trained four classifiers on these 15 datasets to arrive at a conclusion as to which dataset performs the best overall and whether edge features are important for textureless objects. Based on our experiments and analysis, RGB images enhanced with combination of 3 edge features performed the best compared to all others. Model performance on dataset with HED edges performed comparatively better than other edge detectors like Canny or Prewitt.


title: Large Language Models on Fine-grained Emotion Detection Dataset with Data Augmentation and Transfer Learning

abstract: This paper delves into enhancing the classification performance on the GoEmotions dataset, a large, manually annotated dataset for emotion detection in text. The primary goal of this paper is to address the challenges of detecting subtle emotions in text, a complex issue in Natural Language Processing (NLP) with significant practical applications. The findings offer valuable insights into addressing the challenges of emotion detection in text and suggest directions for future research, including the potential for a survey paper that synthesizes methods and performances across various datasets in this domain.


title: Possible GeV gamma-ray emission from the pulsar wind nebula in CTA 1

abstract: We report a detection of GeV $\gamma$-ray emission potentially originating from the pulsar wind nebula in CTA 1 by analyzing about 15 yr of Fermi Large Area Telescope data. By selecting an energy range from 50 GeV to 1 TeV to remove contamination from the $\gamma$-ray pulsar PSR J0007+7303, we have discovered an extended $\gamma$-ray source with a TS value of $\sim$ 44.94 in the region of CTA 1. The obtained flux is measured to be 6.71 $\pm$ 2.60 $\times$ $10^{-12}$ erg $\mathrm{cm}^{-2}$ $\mathrm{s}^{-1}$ with a spectral index of 1.61 $\pm$ 0.36, which allows for a smooth connection with the flux in the TeV band. CTA 1 is also considered to be associated with 1LHAASO J0007+7303u, which is an Ultra-High-Energy source listed in the recently published catalog of the Large High Altitude Air Shower Observatory. We assume that the radiation originates from the pulsar wind nebula and that its multi-wavelength spectral energy distribution can be explained well with a time-dependent one-zone model.