title: Hierarchical structure of metastability in the reversible inclusion process: third time scale and complete characterization

abstract: In this article, we study the hierarchical structure of metastability in the reversible inclusion process. We fully characterize the third time scale of metastability subject to any underlying geometry of the system and prove that this is the last time scale. We also demonstrate that there are no other meaningful time scales except the three identified ones. This work completes the verification of the conjecture made in [7] which was partially resolved on the first time scale in [7] and on the second time scale in [25]. Main tools are potential-theoretic approach and martingale approach to metastability; we thoroughly investigate the highly-complicated energy landscape of the system to construct suitable test objects to provide sharp asymptotics on capacities.


title: Shape dimension of maps

abstract: In this paper we define a numerical shape invariant of a continuous map called shape dimension of a map, which generalizes the shape dimension of a topological space. Some basic properties and applications of this invariant are given. The question of raising the shape dimension by shape finite-dimensional maps is solved. An example of a shape finite-dimensional surjective map between shape infinite-dimensional spaces is given.


title: Solving Math Word Problem with Problem Type Classification

abstract: Math word problems (MWPs) require analyzing text descriptions and generating mathematical equations to derive solutions. Existing works focus on solving MWPs with two types of solvers: tree-based solver and large language model (LLM) solver. However, these approaches always solve MWPs by a single solver, which will bring the following problems: (1) Single type of solver is hard to solve all types of MWPs well. (2) A single solver will result in poor performance due to over-fitting. To address these challenges, this paper utilizes multiple ensemble approaches to improve MWP-solving ability. Firstly, We propose a problem type classifier that combines the strengths of the tree-based solver and the LLM solver. This ensemble approach leverages their respective advantages and broadens the range of MWPs that can be solved. Furthermore, we also apply ensemble techniques to both tree-based solver and LLM solver to improve their performance. For the tree-based solver, we propose an ensemble learning framework based on ten-fold cross-validation and voting mechanism. In the LLM solver, we adopt self-consistency (SC) method to improve answer selection. Experimental results demonstrate the effectiveness of these ensemble approaches in enhancing MWP-solving ability. The comprehensive evaluation showcases improved performance, validating the advantages of our proposed approach. Our code is available at this url: https://github.com/zhouzihao501/NLPCC2023-Shared-Task3-ChineseMWP.


title: Laser-assisted (e,2e) study with twisted electron beam on H-atom

abstract: We study the laser-assisted twisted electron beam impact ionization of the hydrogen atom in coplanar asymmetric geometry. We develope the theoretical model in the first Born approximation. In the presence of the laser field, we treat the incident and scattered electrons as Volkov waves, the ejected electron, moving in the combined field of the laser and residual ion H + , is described by a Coulomb-Volkov wave function . In this communication, we compare the angular profile of triple differential cross-section (TDCS) for laser-assisted twisted electron beam incidence with the plane-wave, laser-assisted plane wave, and field-free twisted electron beam for (e,2e) processes, for different orbital angular momentum (OAM) number (m l ) values. We analyze the influence of the laser parameters (photon exchanged, intensity ) on the angular distribution of the TDCS. We study the (T DCS) av for macroscopic target to examine the effect of opening angle {\theta} p of the twisted electron beam on the angular profile of TDCS. Our results clearly show the impact of laser parameters (electric field ? and number of photon exchanged (l)) and twisted electron beam parameters (OAM number (m l ) and opening angle ({\theta} p )) on the angular distribution of TDCS.


title: Phonon-Mediated Quasiparticle Lifetime Renormalizations in Few-Layer Hexagonal Boron Nitride

abstract: Understanding the collective behavior of the quasiparticles in solid-state systems underpins the field of non-volatile electronics, including the opportunity to control many-body effects for well-desired physical phenomena and their applications. Hexagonal boron nitride (hBN) is a wide energy bandgap semiconductor, showing immense potential as a platform for low-dimensional device heterostructures. It is an inert dielectric used for gated devices, having a negligible orbital hybridization when placed in contact with other systems. Despite its inertness, we discover a large electron mass enhancement in few-layer hBN affecting the lifetime of the $\pi$-band states. We show that the renormalization is phonon-mediated and consistent with both single- and multiple-phonon scattering events. Our findings thus unveil a so-far unknown many-body state in a wide-bandgap insulator, having important implications for devices using hBN as one of their building blocks.


title: Charged-current quasielastic neutrino scattering from $^{12}$C in an extended superscaling model with two-nucleon emission

abstract: The quasielastic cross-section of charged-current neutrino and antineutrino scattering on $^{12}$C is calculated using an improved superscaling model with relativistic effective mass. Our model encompasses two-particle emission induced by neutrinos, which we distinguish into two contributions. The first contribution arises from meson-exchange currents, and its calculation is performed at a microscopic level. The second contribution is phenomenological and extracted from the high-energy tail of the scaling function, assumed to be produced by 2p2h mechanisms where the one-body current plays a role, such as short-range correlations and interferences with MEC, final-state interaction, etc. The model explicitly includes the modification of the relativistic effective mass of the nucleon within the relativistic mean field model of nuclear matter. The meson exchange currents are also consistently calculated within the same model. With this model, we present predictions for the neutrino and antineutrino cross sections of $^{12}$C that have been measured in accelerator experiments.


title: Accurate EH Modelling and Achievable Information Rate for SLIPT Systems with Multi-Junction Photovoltaic Receivers

abstract: In this paper, we study optical simultaneous lightwave information and power transfer (SLIPT) systems employing photovoltaic optical receivers (RXs). To be able to efficiently harvest energy from broadband light, we propose to employ multi-junction photovoltaic cells at the optical RX. We consider the case, where the optical RX is illuminated by ambient light, an intensity-modulated information free space optical (FSO) signal, and since the ambient light may not be always present, a dedicated energy-providing broadband optical signal. Based on the analysis of the equivalent electrical circuit of the multi-junction photovoltaic RX, we model the current flow through the photovoltaic cell and derive a novel accurate and two novel approximate energy harvesting (EH) models for the two cases, where the optical RX is equipped with a single and multiple p-n junctions, respectively. We derive the optimal distribution of the transmit information signal that maximizes the achievable information rate. We validate the proposed EH models by circuit simulations and show that the photovoltaic RXs saturate for high received signal powers. For single-junction RXs, we compare the proposed EH model with two well-known baseline models and demonstrate that, in contrast to the proposed EH model, they are not able to fully capture the RX non-linearity. Since multi-junction RXs allow a more efficient allocation of the optical power, they are more robust against saturation, and thus, are able to harvest significantly more power and achieve higher data rates than RXs employing a single p-n junction. Finally, we highlight a tradeoff between the information rate and harvested power in SLIPT systems and demonstrate that the proposed optimal distribution yields significantly higher achievable information rates compared to uniformly distributed transmit signals, which are optimal for linear optical information RXs.


title: Effectively Heterogeneous Federated Learning: A Pairing and Split Learning Based Approach

abstract: As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense potential, the FL suffers from bottlenecks in training speed due to client heterogeneity, leading to escalated training latency and straggling server aggregation. To deal with this challenge, a novel split federated learning (SFL) framework that pairs clients with different computational resources is proposed, where clients are paired based on computing resources and communication rates among clients, meanwhile the neural network model is split into two parts at the logical level, and each client only computes the part assigned to it by using the SL to achieve forward inference and backward training. Moreover, to effectively deal with the client pairing problem, a heuristic greedy algorithm is proposed by reconstructing the optimization of training latency as a graph edge selection problem. Simulation results show the proposed method can significantly improve the FL training speed and achieve high performance both in independent identical distribution (IID) and Non-IID data distribution.


title: Solutions to Equilibrium HJB Equations for Time-Inconsistent Deterministic Linear Quadratic Control: Characterization and Uniqueness

abstract: In this paper we study a class of HJB equations which solve for equilibria for general time-inconsistent deterministic linear quadratic control problems within the intra-personal game theoretic framework, where the inconsistency arises from non-exponential discount functions. We characterize the solutions to the HJB equations using a class of Riccati equations with integral terms. By studying the uniqueness of solutions to the integro-differential Riccati equations, we prove the uniqueness of solutions to the equilibrium HJB equations.


title: Which is a better programming assistant? A comparative study between chatgpt and stack overflow

abstract: Programmers often seek help from Q\&A websites to resolve issues they encounter during programming. Stack Overflow has been a widely used platform for this purpose for over a decade. Recently, revolutionary AI-powered platforms like ChatGPT have quickly gained popularity among programmers for their efficient and personalized programming assistance via natural language interactions. Both platforms can offer valuable assistance to programmers, but it's unclear which is more effective at enhancing programmer productivity. In our paper, we conducted an exploratory user study to compare the performance of Stack Overflow and ChatGPT in enhancing programmer productivity. Two groups of students with similar programming abilities were instructed to use the two platforms to solve three different types of programming tasks: algorithmic challenges, library usage, and debugging. During the experiments, we measured and compared the quality of code produced and the time taken to complete tasks for the two groups. The results show that, concerning code quality, ChatGPT outperforms Stack Overflow significantly in helping complete algorithmic and library-related tasks, while Stack Overflow is better for debugging tasks. Regarding task completion speed, the ChatGPT group is obviously faster than the Stack Overflow group in the algorithmic challenge, but the two groups have a similar performance in the other two tasks. Additionally, we conducted a post-experiment survey with the participants to understand how the platforms have helped them complete the programming tasks. We analyzed the questionnaires to summarize ChatGPT and Stack Overflow's strengths and weaknesses pointed out by the participants. By comparing these, we identified the reasons behind the two platforms' divergent performances in programming assistance.


title: Controlling Work Output and Coherence in Finite Time Quantum Otto Engines Through Monitoring

abstract: We examine the role of diagnostic quantum measurements on the work statistics of a finite-time quantum Otto heat engine operated in the steady-state. We consider three pointer-based measurement schemes that differ in the number of system-pointer interactions and pointer measurements. We show that the coherence of the working substance and the work output of the engine can be controlled by tuning the monitoring measurements. Moreover, for a working substance consisting of a two-level system we show that while all three schemes reproduce the predictions of the cycle without any monitoring for the average work in the limit of infinitely weak measurement, only two of the schemes can reproduce the two-point projective measurement results in the limit of strong measurement.


title: Beyond One-to-One: Rethinking the Referring Image Segmentation

abstract: Referring image segmentation aims to segment the target object referred by a natural language expression. However, previous methods rely on the strong assumption that one sentence must describe one target in the image, which is often not the case in real-world applications. As a result, such methods fail when the expressions refer to either no objects or multiple objects. In this paper, we address this issue from two perspectives. First, we propose a Dual Multi-Modal Interaction (DMMI) Network, which contains two decoder branches and enables information flow in two directions. In the text-to-image decoder, text embedding is utilized to query the visual feature and localize the corresponding target. Meanwhile, the image-to-text decoder is implemented to reconstruct the erased entity-phrase conditioned on the visual feature. In this way, visual features are encouraged to contain the critical semantic information about target entity, which supports the accurate segmentation in the text-to-image decoder in turn. Secondly, we collect a new challenging but realistic dataset called Ref-ZOM, which includes image-text pairs under different settings. Extensive experiments demonstrate our method achieves state-of-the-art performance on different datasets, and the Ref-ZOM-trained model performs well on various types of text inputs. Codes and datasets are available at https://github.com/toggle1995/RIS-DMMI.


title: The Multiwavelength Picture of GRB 221009A's Afterglow

abstract: We present counts-level fits to the keV-GeV data of the early afterglow of the brightest gamma-ray burst detected to date, GRB 221009A. We discuss the complexity of the data reduction due to the unprecedented brightness and the location in the Galactic plane. We find the energy spectrum to be well described as a smoothly broken power law with a break around 10 keV and no indications for additional features towards GeV energies. An interpretation as synchrotron emission from forward-shock accelerated and subsequently cooled electrons yields three possible types of solutions: (1) a slow cooling solution with low magnetic fields (few percent of a Gauss) but poorly constrained minimum injected electron energy (<100 GeV), (2) a fast cooling solution with stronger magnetic fields (few percent to few Gauss) and minimum injected electron energy 10-100 GeV or (3) the transition between both regimes with low magnetic fields and minimum injected electron energy around 100 GeV. Limited statistics at GeV energies prevent conclusions extrapolating towards a cut-off or the onset of a new component at higher energies.


title: Non-equilibrium spin polarisation via interfacial exchange-field spin filtering

abstract: A key phenomenon that enables nanoscale spintronic devices is the efficient inter-conversion between spin and charge degrees of freedom. Here, we experimentally demonstrate a pathway to generate current-induced spin polarization at the interface between an insulating ferromagnet and a non-magnetic metal using interfacial exchange-field spin filtering. Measuring current-in-plane giant magnetoresistance in Py$|$Cu$|$EuS trilayer Hall cross devices, we induce a non-equilibrium spin polarization of $P_\text{neq}^\text{Cu|EuS}$=0.6% at a low charge current density of 1.88$\times$10$^3$ A/cm$^2$. This efficiency is comparable to that of conventional charge-to-spin conversion of spin-Hall or Rashba-Edelstein effects enabled by relativistic spin-orbit coupling. Interfacial exchange field filtering allows operation with largely reduced power consumption and magnetic reconfigurability, opening new pathways to nanoscale low-power insulator spintronics.


title: Activity Induced Enhanced Diffusion of a Polymer in Poor Solvent

abstract: By means of Brownian dynamics simulations we study the steady-state dynamic properties of a flexible active polymer in a poor solvent condition. Our results show that the effective diffusion constant of the polymer $D_{\rm eff}$ gets significantly enhanced as activity increases, much like in active particles. The simulation data are in agreement with a theoretically constructed Rouse model of active polymer, demonstrating that irrespective of the strength of activity, the long-time dynamics of the polymer chain is characterized by a universal Rouse-like scaling $D_{\rm eff} \sim N^{-1}$, where $N$ is the chain length.


title: Joint Gaze-Location and Gaze-Object Detection

abstract: This paper proposes an efficient and effective method for joint gaze location detection (GL-D) and gaze object detection (GO-D), \emph{i.e.}, gaze following detection. Current approaches frame GL-D and GO-D as two separate tasks, employing a multi-stage framework where human head crops must first be detected and then be fed into a subsequent GL-D sub-network, which is further followed by an additional object detector for GO-D. In contrast, we reframe the gaze following detection task as detecting human head locations and their gaze followings simultaneously, aiming at jointly detect human gaze location and gaze object in a unified and single-stage pipeline. To this end, we propose GTR, short for \underline{G}aze following detection \underline{TR}ansformer, streamlining the gaze following detection pipeline by eliminating all additional components, leading to the first unified paradigm that unites GL-D and GO-D in a fully end-to-end manner. GTR enables an iterative interaction between holistic semantics and human head features through a hierarchical structure, inferring the relations of salient objects and human gaze from the global image context and resulting in an impressive accuracy. Concretely, GTR achieves a 12.1 mAP gain ($\mathbf{25.1}\%$) on GazeFollowing and a 18.2 mAP gain ($\mathbf{43.3\%}$) on VideoAttentionTarget for GL-D, as well as a 19 mAP improvement ($\mathbf{45.2\%}$) on GOO-Real for GO-D. Meanwhile, unlike existing systems detecting gaze following sequentially due to the need for a human head as input, GTR has the flexibility to comprehend any number of people's gaze followings simultaneously, resulting in high efficiency. Specifically, GTR introduces over a $\times 9$ improvement in FPS and the relative gap becomes more pronounced as the human number grows.


title: A Spatially Non-stationary Fading Channel Model for Simulation and (Semi-) Analytical Study of ELAA-MIMO

abstract: In this paper, a novel spatially non-stationary fading channel model is proposed for multiple-input multiple-output (MIMO) system with extremely-large aperture service-array (ELAA). The proposed model incorporates three key factors which cause the channel spatial non-stationarity: 1) link-wise path-loss; 2) shadowing effect; 3) line-of-sight (LoS)/non-LoS state. With appropriate parameter configurations, the proposed model can be used to generate computer-simulated channel data that matches the published measurement data from practical ELAA-MIMO channels. Given such appealing results, the proposed fading channel model is employed to study the cumulative distribution function (CDF) of ELAA-MIMO channel capacity. For all of our studied scenarios, it is unveiled that the ELAA-MIMO channel capacity obeys the skew-normal distribution. Moreover, the channel capacity is also found close to the Gaussian or Weibull distribution, depending on users' geo-location and distribution. More specifically, for single-user equivalent scenarios or multiuser scenarios with short user-to-ELAA distances (e.g., 1 m), the channel capacity is close to the Gaussian distribution; and for others, it is close to the Weibull distribution. Finally, the proposed channel model is also employed to study the impact of channel spatial non-stationarity on linear MIMO receivers through computer simulations. The proposed fading channel model is available at https://github.com/ELAA-MIMO/non-stationary-fading-channel-model.


title: Long-distance high-fidelity continuous-variable quantum key distribution with non-Gaussian operations: An exact closed form solution

abstract: In this paper, we derive a closed form expression for the output state of a CV-QKD protocol in the presence of zero-photon catalysis (ZPC) and quantum scissor (QS). Then, based on this closed form solution, we use direct search algorithm to find the appropriate values of input state and QS parameters, which considerably enhance the range and the fidelity of a CV-QKD protocol. In the special case of pure loss channel, the largest range of the protocol is only 6.5% less than the fundamental limit of repeaterless quantum communication. In addition, examination of the protocol for different values of excess noise, reveals that their is a trade-off between range and fidelity, and high value of fidelity can be obtained at the cost of a slight reduction in protocol range.


title: Holomorphic Higgs bundles over the Teichm\"uller space

abstract: We study which representations $\rho$ of the fundamental group of a compact oriented surface $X$ admit Higgs data that depend holomorphically on the Riemann surface $\Sigma\,=\, (X,\, J)$ via non-abelian Hodge correspondence. For representations $\rho$ into $\mathrm{SL}(2,\mathbb C)$ we show that holomorphic dependency is equivalent to $\rho$ being unitary. For higher ranks this equivalence fails -- we show the existence of non-unitary and irreducible representations of the fundamental group into $\mathrm{SL}(n,\mathbb C)$ admitting Higgs data that are holomorphic in $\Sigma$, for $n$ large enough.


title: Bias in Unsupervised Anomaly Detection in Brain MRI

abstract: Unsupervised anomaly detection methods offer a promising and flexible alternative to supervised approaches, holding the potential to revolutionize medical scan analysis and enhance diagnostic performance. In the current landscape, it is commonly assumed that differences between a test case and the training distribution are attributed solely to pathological conditions, implying that any disparity indicates an anomaly. However, the presence of other potential sources of distributional shift, including scanner, age, sex, or race, is frequently overlooked. These shifts can significantly impact the accuracy of the anomaly detection task. Prominent instances of such failures have sparked concerns regarding the bias, credibility, and fairness of anomaly detection. This work presents a novel analysis of biases in unsupervised anomaly detection. By examining potential non-pathological distributional shifts between the training and testing distributions, we shed light on the extent of these biases and their influence on anomaly detection results. Moreover, this study examines the algorithmic limitations that arise due to biases, providing valuable insights into the challenges encountered by anomaly detection algorithms in accurately learning and capturing the entire range of variability present in the normative distribution. Through this analysis, we aim to enhance the understanding of these biases and pave the way for future improvements in the field. Here, we specifically investigate Alzheimer's disease detection from brain MR imaging as a case study, revealing significant biases related to sex, race, and scanner variations that substantially impact the results. These findings align with the broader goal of improving the reliability, fairness, and effectiveness of anomaly detection in medical imaging.


title: Late Stopping: Avoiding Confidently Learning from Mislabeled Examples

abstract: Sample selection is a prevalent method in learning with noisy labels, where small-loss data are typically considered as correctly labeled data. However, this method may not effectively identify clean hard examples with large losses, which are critical for achieving the model's close-to-optimal generalization performance. In this paper, we propose a new framework, Late Stopping, which leverages the intrinsic robust learning ability of DNNs through a prolonged training process. Specifically, Late Stopping gradually shrinks the noisy dataset by removing high-probability mislabeled examples while retaining the majority of clean hard examples in the training set throughout the learning process. We empirically observe that mislabeled and clean examples exhibit differences in the number of epochs required for them to be consistently and correctly classified, and thus high-probability mislabeled examples can be removed. Experimental results on benchmark-simulated and real-world noisy datasets demonstrate that the proposed method outperforms state-of-the-art counterparts.


title: Full-scale ab initio simulations of laser-driven atomistic dynamics

abstract: The coupling of excited states and ionic dynamics is the basic and challenging point for the materials response at extreme conditions. In laboratory, the intense laser produces transient nature and complexity with highly nonequilibrium states, making it extremely difficult and interesting for both experimental measurements and theoretical methods. With the inclusion of laser-excited states, we extended ab initio method into the direct simulations of whole laser-driven microscopic dynamics from solid to liquid. We constructed the framework of combining the electron-temperaturedependent deep neural network potential energy surface with hybrid atomistic-continuum approach, controlling non-adiabatic energy exchange and atomistic dynamics, which enables consistent interpretation of experimental data. By large scale ab inito simulations, we demonstrate that the nonthermal effects introduced by hot electrons play a dominant role in modulating the lattice dynamics, thermodynamic pathway, and structural transformation. We highlight that the present work provides a path to realistic computational studies of laser-driven processes, thus bridging the gap between experiments and simulations.


title: Asymptotics of quantum $6j$-symbols and generalized hyperbolic tetrahedra

abstract: We establish the geometry behind the quantum $6j$-symbols under only the admissibility conditions as in the definition of the Turaev-Viro invariants of $3$-manifolds. As a classification, we show that the $6$-tuples in the quantum $6j$-symbols give in a precise way to the dihedral angles of (1) a spherical tetrahedron, (2) a generalized Euclidean tetrahedron, (3) a generalized hyperbolic tetrahedron or (4) in the degenerate case the angles between four oriented straight lines in the Euclidean plane. We also show that for a large proportion of the cases, the $6$-tuples always give the dihedral angles of a generalized hyperbolic tetrahedron and the exponential growth rate of the corresponding quantum $6j$-symbols equals the suitably defined volume of this generalized hyperbolic tetrahedron. It is worth mentioning that the volume of a generalized hyperbolic tetrahedron can be negative, hence the corresponding sequence of the quantum $6j$-symbols could decay exponentially. This is a phenomenon that has never been aware of before.


title: Non-uniform convergence of solution for the Camassa-Holm equation in the zero-filter limit

abstract: In the short note, we prove that given initial data $\mathcal{u}_0 \in \pmb{H}^s(\mathbb{R})$ with $s>\frac32$ and for some $T>0$, the solution of the Camassa-Holm equation does not converges uniformly with respect to the initial data in $\pmb{L}^\infty$ $(0,T;H^s(\mathbb{R}))$ to the inviscid Burgers equation as the filter parameter $\alpha$ tends to zero. This is a supplement to our recent result on the zero-filter limit.


title: Improving Video Violence Recognition with Human Interaction Learning on 3D Skeleton Point Clouds

abstract: Deep learning has proved to be very effective in video action recognition. Video violence recognition attempts to learn the human multi-dynamic behaviours in more complex scenarios. In this work, we develop a method for video violence recognition from a new perspective of skeleton points. Unlike the previous works, we first formulate 3D skeleton point clouds from human skeleton sequences extracted from videos and then perform interaction learning on these 3D skeleton point clouds. Specifically, we propose two types of Skeleton Points Interaction Learning (SPIL) strategies: (i) Local-SPIL: by constructing a specific weight distribution strategy between local regional points, Local-SPIL aims to selectively focus on the most relevant parts of them based on their features and spatial-temporal position information. In order to capture diverse types of relation information, a multi-head mechanism is designed to aggregate different features from independent heads to jointly handle different types of relationships between points. (ii) Global-SPIL: to better learn and refine the features of the unordered and unstructured skeleton points, Global-SPIL employs the self-attention layer that operates directly on the sampled points, which can help to make the output more permutation-invariant and well-suited for our task. Extensive experimental results validate the effectiveness of our approach and show that our model outperforms the existing networks and achieves new state-of-the-art performance on video violence datasets.


title: Certification of non-Gaussian Einstein-Podolsky-Rosen Steering

abstract: Non-Gaussian quantum states are a known necessary resource for reaching a quantum advantage and for violating Bell inequalities in continuous variable systems. As one kind of manifestation of quantum correlations, Einstein-Podolsky-Rosen (EPR) steering enables verification of shared entanglement even when one of the subsystems is not characterized. However, how to detect and classify such an effect for non-Gaussian states is far from being well understood. Here, we present an efficient non-Gaussian steering criterion based on the high-order observables and conduct a systematic investigation into the hierarchy of non-Gaussian steering criteria. Moreover, we apply our criterion to three experimentally-relevant non-Gaussian states under realistic conditions and, in particular, propose a feasible scheme to create multi-component cat states with tunable size by performing a suitable high-order quadrature measurement on the steering party. Our work reveals the fundamental characteristics of non-Gaussianity and quantum correlations, and offers new insights to explore their applications in quantum information processing.


title: A Graph-Theoretic Model for a Generic Three Jug Puzzle

abstract: In a classic three jug puzzle we have three jugs $A$, $B$, and $C$ with some fixed capacities. The jug $A$ is fully filled with wine to its capacity. The goal of the puzzle is to divide the wine into two equal halves by pouring it from one jug to another without using any other measuring devices. However, we consider a generic version of the three jug puzzle and present an independent graph theoretic model to determine whether the puzzle has a solution at first place. If it has a solution, then the same can be determined using this model. We also present the sketch of an algorithm to determine the solution of the puzzle.


title: A More Scalable Sparse Dynamic Data Exchange

abstract: Parallel architectures are continually increasing in performance and scale, while underlying algorithmic infrastructure often fail to take full advantage of available compute power. Within the context of MPI, irregular communication patterns create bottlenecks in parallel applications. One common bottleneck is the sparse dynamic data exchange, often required when forming communication patterns within applications. There are a large variety of approaches for these dynamic exchanges, with optimizations implemented directly in parallel applications. This paper proposes a novel API within an MPI extension library, allowing for applications to utilize the variety of provided optimizations for sparse dynamic data exchange methods. Further, the paper presents novel locality-aware sparse dynamic data exchange algorithms. Finally, performance results show significant speedups up to 20x with the novel locality-aware algorithms.


title: Brain-like representational straightening of natural movies in robust feedforward neural networks

abstract: Representational straightening refers to a decrease in curvature of visual feature representations of a sequence of frames taken from natural movies. Prior work established straightening in neural representations of the primate primary visual cortex (V1) and perceptual straightening in human behavior as a hallmark of biological vision in contrast to artificial feedforward neural networks which did not demonstrate this phenomenon as they were not explicitly optimized to produce temporally predictable movie representations. Here, we show robustness to noise in the input image can produce representational straightening in feedforward neural networks. Both adversarial training (AT) and base classifiers for Random Smoothing (RS) induced remarkably straightened feature codes. Demonstrating their utility within the domain of natural movies, these codes could be inverted to generate intervening movie frames by linear interpolation in the feature space even though they were not trained on these trajectories. Demonstrating their biological utility, we found that AT and RS training improved predictions of neural data in primate V1 over baseline models providing a parsimonious, bio-plausible mechanism -- noise in the sensory input stages -- for generating representations in early visual cortex. Finally, we compared the geometric properties of frame representations in these networks to better understand how they produced representations that mimicked the straightening phenomenon from biology. Overall, this work elucidating emergent properties of robust neural networks demonstrates that it is not necessary to utilize predictive objectives or train directly on natural movie statistics to achieve models supporting straightened movie representations similar to human perception that also predict V1 neural responses.


abstract: Recently, more and more research has focused on using Graph Neural Networks (GNN) to solve the Graph Similarity Computation problem (GSC), i.e., computing the Graph Edit Distance (GED) between two graphs. These methods treat GSC as an end-to-end learnable task, and the core of their architecture is the feature fusion modules to interact with the features of two graphs. Existing methods consider that graph-level embedding is difficult to capture the differences in local small structures between two graphs, and thus perform fine-grained feature fusion on node-level embedding can improve the accuracy, but leads to greater time and memory consumption in the training and inference phases. However, this paper proposes a novel graph-level fusion module Different Attention (DiffAtt), and demonstrates that graph-level fusion embeddings can substantially outperform these complex node-level fusion embeddings. We posit that the relative difference structure of the two graphs plays an important role in calculating their GED values. To this end, DiffAtt uses the difference between two graph-level embeddings as an attentional mechanism to capture the graph structural difference of the two graphs. Based on DiffAtt, a new GSC method, named Graph Edit Distance Learning via Different Attention (REDRAFT), is proposed, and experimental results demonstrate that REDRAFT achieves state-of-the-art performance in 23 out of 25 metrics in five benchmark datasets. Especially on MSE, it respectively outperforms the second best by 19.9%, 48.8%, 29.1%, 31.6%, and 2.2%. Moreover, we propose a quantitative test Remaining Subgraph Alignment Test (RESAT) to verify that among all graph-level fusion modules, the fusion embedding generated by DiffAtt can best capture the structural differences between two graphs.


title: Vision-Based Human Pose Estimation via Deep Learning: A Survey

abstract: Human pose estimation (HPE) has attracted a significant amount of attention from the computer vision community in the past decades. Moreover, HPE has been applied to various domains, such as human-computer interaction, sports analysis, and human tracking via images and videos. Recently, deep learning-based approaches have shown state-of-the-art performance in HPE-based applications. Although deep learning-based approaches have achieved remarkable performance in HPE, a comprehensive review of deep learning-based HPE methods remains lacking in the literature. In this article, we provide an up-to-date and in-depth overview of the deep learning approaches in vision-based HPE. We summarize these methods of 2-D and 3-D HPE, and their applications, discuss the challenges and the research trends through bibliometrics, and provide insightful recommendations for future research. This article provides a meaningful overview as introductory material for beginners to deep learning-based HPE, as well as supplementary material for advanced researchers.


title: Digital Twin conceptual framework for the O&M process of cubature building objects

abstract: The broader construction industry is struggling with data loss, inefficient processes and low productivity in asset management. The remedy to these problems seems to be the idea of Digital Twin (DT). However, the frameworks proposed so far do not always support a solution to these problems. This paper conducts an extensive literature review to develop a conceptual framework for the Operation and Maintenance (O&M) phase for cubic facilities. The conceptual framework takes into account the increasingly popular Internet of Things (IoT) and Artificial Intelligence (AI) technologies. The presented framework, after appropriate modifications, can also be applied to infrastructure facilities or city fragments. The paper presents limitations and directions for further research. The DT paradigm has been adopted and its adoption is ongoing. Its implementation will progress in the coming years.


title: Sufficient conditions for $k$-factors and spanning trees of graphs

abstract: For any integer $k\geq1,$ a graph $G$ has a $k$-factor if it contains a $k$-regular spanning subgraph. In this paper we prove a sufficient condition in terms of the number of $r$-cliques to guarantee the existence of a $k$-factor in a graph with minimum degree at least $\delta$, which improves the sufficient condition of O \cite{O2021} based on the number of edges. For any integer $k\geq2,$ a spanning $k$-tree of a connected graph $G$ is a spanning tree in which every vertex has degree at most $k$. Motivated by the technique of Li and Ning \cite{Li2016}, we present a tight spectral condition for an $m$-connected graph to have a spanning $k$-tree, which extends the result of Fan, Goryainov, Huang and Lin \cite{Fan2021} from $m=1$ to general $m$. Let $T$ be a spanning tree of a connected graph. The leaf degree of $T$ is the maximum number of leaves adjacent to $v$ in $T$ for any $v\in V(T)$. We provide a tight spectral condition for the existence of a spanning tree with leaf degree at most $k$ in a connected graph with minimum degree $\delta$, where $k\geq1$ is an integer.


title: Performance of Genetic Algorithms in the Context of Software Model Refactoring

abstract: Software systems continuously evolve due to new functionalities, requirements, or maintenance activities. In the context of software evolution, software refactoring has gained a strategic relevance. The space of possible software refactoring is usually very large, as it is given by the combinations of different refactoring actions that can produce software system alternatives. Multi-objective algorithms have shown the ability to discover alternatives by pursuing different objectives simultaneously. Performance of such algorithms in the context of software model refactoring is of paramount importance. Therefore, in this paper, we conduct a performance analysis of three genetic algorithms to compare them in terms of performance and quality of solutions. Our results show that there are significant differences in performance among the algorithms (e.g., PESA2 seems to be the fastest one, while NSGA-II shows the least memory usage).


title: Class Binarization to NeuroEvolution for Multiclass Classification

abstract: Multiclass classification is a fundamental and challenging task in machine learning. The existing techniques of multiclass classification can be categorized as (i) decomposition into binary (ii) extension from binary and (iii) hierarchical classification. Decomposing multiclass classification into a set of binary classifications that can be efficiently solved by using binary classifiers, called class binarization, which is a popular technique for multiclass classification. Neuroevolution, a general and powerful technique for evolving the structure and weights of neural networks, has been successfully applied to binary classification. In this paper, we apply class binarization techniques to a neuroevolution algorithm, NeuroEvolution of Augmenting Topologies (NEAT), that is used to generate neural networks for multiclass classification. We propose a new method that applies Error-Correcting Output Codes (ECOC) to design the class binarization strategies on the neuroevolution for multiclass classification. The ECOC strategies are compared with the class binarization strategies of One-vs-One and One-vs-All on three well-known datasets Digit, Satellite, and Ecoli. We analyse their performance from four aspects of multiclass classification degradation, accuracy, evolutionary efficiency, and robustness. The results show that the NEAT with ECOC performs high accuracy with low variance. Specifically, it shows significant benefits in a flexible number of binary classifiers and strong robustness.


title: Applications of machine Learning to improve the efficiency and range of microbial biosynthesis: a review of state-of-art techniques

abstract: In the modern world, technology is at its peak. Different avenues in programming and technology have been explored for data analysis, automation, and robotics. Machine learning is key to optimize data analysis, make accurate predictions, and hasten/improve existing functions. Thus, presently, the field of machine learning in artificial intelligence is being developed and its uses in varying fields are being explored. One field in which its uses stand out is that of microbial biosynthesis. In this paper, a comprehensive overview of the differing machine learning programs used in biosynthesis is provided, alongside brief descriptions of the fields of machine learning and microbial biosynthesis separately. This information includes past trends, modern developments, future improvements, explanations of processes, and current problems they face. Thus, this paper's main contribution is to distill developments in, and provide a holistic explanation of, 2 key fields and their applicability to improve industry/research. It also highlights challenges and research directions, acting to instigate more research and development in the growing fields. Finally, the paper aims to act as a reference for academics performing research, industry professionals improving their processes, and students looking to understand the concept of machine learning in biosynthesis.


title: On negaFibonacci-esque Sequences and Their Relation to the Golden Ratio

abstract: The Fibonacci sequence, $F_n = F_{n - 1} + F_{n - 2}$, and its counterpart for $n < 0$, the negaFibonacci sequence, $F_{-n} = (-1)^{n + 1} \cdot F_n$, are among the most studied sequences in mathematics. In this paper we will present a new kind of sequence, the negaFibonacci-esque sequences, identified by the property that $\omega_n = \omega_{n - 2} - \omega_{n - 1}$ with $\omega_1, \omega_2 \in \mathbb{C}$ chosen at will. We will partition this kind into natural complete and complex complete negaFibonacci-esque sequences.We will prove that $\frac{1}{\phi^n}$, referred to as the principal negaFibonacci-esque sequence, is not only a complex complete negaFibonacci-esque sequence but also one of the most significant. Furthermore, we will present an explicit formula for all complex complete negaFibonacci-esque sequences constructed with a combination of two negaFibonacci terms. We shall then conclude by connecting these sequences to the golden spiral and ratio.


title: The DiffuseStyleGesture+ entry to the GENEA Challenge 2023

abstract: In this paper, we introduce the DiffuseStyleGesture+, our solution for the Generation and Evaluation of Non-verbal Behavior for Embodied Agents (GENEA) Challenge 2023, which aims to foster the development of realistic, automated systems for generating conversational gestures. Participants are provided with a pre-processed dataset and their systems are evaluated through crowdsourced scoring. Our proposed model, DiffuseStyleGesture+, leverages a diffusion model to generate gestures automatically. It incorporates a variety of modalities, including audio, text, speaker ID, and seed gestures. These diverse modalities are mapped to a hidden space and processed by a modified diffusion model to produce the corresponding gesture for a given speech input. Upon evaluation, the DiffuseStyleGesture+ demonstrated performance on par with the top-tier models in the challenge, showing no significant differences with those models in human-likeness, appropriateness for the interlocutor, and achieving competitive performance with the best model on appropriateness for agent speech. This indicates that our model is competitive and effective in generating realistic and appropriate gestures for given speech. The code, pre-trained models, and demos are available at https://github.com/YoungSeng/DiffuseStyleGesture/tree/DiffuseStyleGesturePlus/BEAT-TWH-main.


title: A topological viewpoint on curves via intersection

abstract: This paper explores the relationship between closed curves on surfaces and their intersections. Like Dehn-Thurston coordinates for simple curves, we explore how to determine closed curves using the number of times they intersect other curves. We construct and study $k$-equivalent curves: these are distinct curves that intersect all curves with $k$ self-intersection points the same number of times. We show that such curves must intersect all simple curves in the same way, but that all other possible implications fail. Our methods give a quantitative approach to a theorem of Otal which shows that curves are determined by their intersection with all other curves. In the opposite direction, we show that non-simple curves can only be distinguished by looking at their intersection with infinitely many curves.


title: Transaction fee mechanism for Proof-of-Stake protocol

abstract: We study a mechanism design problem in the blockchain proof-of-stake (PoS) protocol. Our main objective is to extend the transaction fee mechanism (TFM) recently proposed in Chung and Shi (SODA, p.3856-3899, 2023), so as to incorporate a long-run utility model for the miner into the burning second-price auction mechanism $\texttt{BSP}(\gamma)$ proposed in Chung and Shi (where $\gamma$ is a key parameter in the strict $\gamma$-utility model that is applied to both miners and users). First, we derive an explicit functional form for the long-run utility of the miner using a martingale approach, and reveal a critical discontinuity of the utility function, namely a small deviation from being truthful will yield a discrete jump (up or down) in the miner's utility. We show that because of this discontinuity the $\texttt{BSP}(\gamma)$ mechanism will fail a key desired property in TFM, $c$-side contract proofness ($c$-SCP). As a remedy, we introduce another parameter $\theta$, and propose a new $\texttt{BSP}(\theta)$ mechanism, and prove that it satisfies all three desired properties of TFM: user- and miner-incentive compatibility (UIC and MIC) as well as $c$-SCP, provided the parameter $\theta$ falls into a specific range, along with a proper tick size imposed on user bids.


title: Variations on shuffle squares

abstract: A \emph{square} is a word of the form $UU$, where $U$ is any finite nonempty word. For instance, $\mathtt{\color{red}{0102}\color{blue}{0102}}$ is a square. A \emph{shuffle square} is a word that can be split into two identical (scattered) subwords. For example, $\mathtt{\color{red}{01}\color{blue}{0}\color{red}{0}\color{blue}{102}\color{red}{2}}$ is a shuffle square, but not a square. We discuss known and new problems concerning shuffle squares. In particular, we introduce generalized shuffle squares involving various types of word similarities with respect to fixed kinds of permutations (cyclic, reverse, dihedral, etc.). We propose a number of conjectures and provide some initial results towards them. For instance, we prove that every \emph{even} binary word (i.e. a word with even number of $\mathtt{1}$'s and even number of $\mathtt{0}$'s) is a \emph{cyclic} shuffle square, meaning it splits into two subwords, one of which is a~cyclic permutation of the other. The same statement is no longer true over larger alphabets, but it seems plausible that a similar property should hold with less restricted permutation classes (depending on the alphabet size). For instance, we conjecture that every even ternary word is a \emph{dihedral} shuffle square, i.e. it splits into two subwords, one of which can be obtained from the other by a permutation corresponding to the~symmetry of a~regular polygon. We propose a general conjecture stating that a linear number of permutations is sufficient to express all even $k$-ary words as generalized shuffle squares. Our discussion is complemented by some enumerative and computational experiments. In particular, we determine the precise number of shuffle squares with exactly two $\mathtt{1}$'s and confirm our main conjecture for all binary words of length at most $20$.


title: ReFuSeg: Regularized Multi-Modal Fusion for Precise Brain Tumour Segmentation

abstract: Semantic segmentation of brain tumours is a fundamental task in medical image analysis that can help clinicians in diagnosing the patient and tracking the progression of any malignant entities. Accurate segmentation of brain lesions is essential for medical diagnosis and treatment planning. However, failure to acquire specific MRI imaging modalities can prevent applications from operating in critical situations, raising concerns about their reliability and overall trustworthiness. This paper presents a novel multi-modal approach for brain lesion segmentation that leverages information from four distinct imaging modalities while being robust to real-world scenarios of missing modalities, such as T1, T1c, T2, and FLAIR MRI of brains. Our proposed method can help address the challenges posed by artifacts in medical imagery due to data acquisition errors (such as patient motion) or a reconstruction algorithm's inability to represent the anatomy while ensuring a trade-off in accuracy. Our proposed regularization module makes it robust to these scenarios and ensures the reliability of lesion segmentation.


title: Location Privacy and Spectrum Efficiency Enhancement in Spectrum Sharing Systems

abstract: In this work, we investigate the benefits of secondary user (SU) network beamforming on improving primary user (PU) location privacy in spectrum sharing systems, where the beamformer in the SU network is designed to suppress the aggregate interference to improve the location privacy of PUs. We consider two problems: improving SU network communication throughput subject to the specified PU location privacy requirements, and enhancing PU location privacy given the quality of service (QoS) requirements of SU networks. In the first problem, we provide an algorithm to achieve high data rates with the constrained PU location privacy level. Numerical results show that for a given PU location privacy requirement, the proposed scheme is able to interfere/exclude only a few SU nodes from the PU band and the network throughput can be greatly improved. In the second problem, to fully explore the potential of SU network beamforming for enhancing PU location privacy, we propose a two-step scheme to decouple the beamforming and privacy zone design so that the PU location privacy can be improved while satisfying the SU network throughput requirement. According to numerical evaluations, the proposed scheme can maintain/achieve higher PU location privacy than the benchmark beamforming schemes while satisfying a QoS requirement for the SU network.


title: Exploring Room-Temperature Superconductivity in Narrow Energy Gap Semiconductors through Thermally Excited Electrons

abstract: The impact of thermally activated electrons on superconductivity within the realm of narrow energy gap semiconductors is investigated, unveiling the potential emergence of room-temperature superconductivity without the necessity for extensive doping. This novel mechanism suggests that thermal excitations can influence carrier concentrations significantly, thus influencing condensation and affecting superconductivity properties. In this paper, we explore how the energy gap width and temperature interact to shape carrier concentrations and subsequently impact the manifestation of superconducting behavior.


title: Existence and uniqueness of nonsimple multiple SLE

abstract: We prove the existence and uniqueness of multiple SLE$_\kappa$ associated with any given link pattern for $\kappa\in (4,6]$. We also have the uniqueness for $\kappa\in (6,8)$. The multiple SLE$_\kappa$ law is constructed by first inductively constructing a $\sigma$-finite multiple SLE$_\kappa$ measure and then normalizing the measure whenever it is finite. The total mass of the measure satisfies the conformal covariance, asymptotics and PDE for multiple SLE$_\kappa$ partition functions in the literature subject to the assumption that it is smooth.


title: Quantum walks on blow-up graphs

abstract: A blow-up of $n$ copies of a graph $G$ is the graph $\overset{n}\uplus~G$ obtained by replacing every vertex of $G$ by an independent set of size $n$, where the copies of vertices in $G$ are adjacent in the blow-up if and only if the vertices adjacent in $G$. Our goal is to investigate the existence of quantum state transfer on a blow-up graph $\overset{n}\uplus~G$, where the adjacency matrix is taken to be the time-independent Hamiltonian of the quantum system represented by $\overset{n}\uplus~G$. In particular, we establish necessary and sufficient conditions for vertices in a blow-up graph to exhibit strong cospectrality and various types of high probability quantum transport, such as periodicity, perfect state transfer (PST) and pretty good state transfer (PGST). It turns out, if $\overset{n}\uplus~G$ admits PST or PGST, then one must have $n=2.$ Moreover, if $G$ has an invertible adjacency matrix, then we show that every vertex in $\overset{2}\uplus~G$ pairs up with a unique vertex to exhibit strong cospectrality. We then apply our results to determine infinite families of graphs whose blow-ups admit PST and PGST.


title: Neural Implicit Morphing of Face Images

abstract: Face morphing is a problem in computer graphics with numerous artistic and forensic applications. It is challenging due to variations in pose, lighting, gender, and ethnicity. This task consists of a warping for feature alignment and a blending for a seamless transition between the warped images. We propose to leverage coord-based neural networks to represent such warpings and blendings of face images. During training, we exploit the smoothness and flexibility of such networks by combining energy functionals employed in classical approaches without discretizations. Additionally, our method is time-dependent, allowing a continuous warping/blending of the images. During morphing inference, we need both direct and inverse transformations of the time-dependent warping. The first (second) is responsible for warping the target (source) image into the source (target) image. Our neural warping stores those maps in a single network dismissing the need for inverting them. The results of our experiments indicate that our method is competitive with both classical and generative models under the lens of image quality and face-morphing detectors. Aesthetically, the resulting images present a seamless blending of diverse faces not yet usual in the literature.


title: HI in Molecular Clouds: Irradiation by FUV plus Cosmic Rays

abstract: We extend the analytic theory presented by Sternberg et al. (2014) and Bialy & Sternberg (2016) for the production of atomic hydrogen (HI) via FUV photodissociation at the boundaries of dense interstellar molecular (H$_2$) clouds, to also include the effects of penetrating (low-energy) cosmic-rays for the growth of the total HI column densities. We compute the steady-state abundances of the HI and H$_2$ in one-dimensional gas slabs in which the FUV photodissociation rates are reduced by depth-dependent H$_2$ self-shielding and dust absorption, and in which the cosmic-ray ionization rates are either constant or reduced by transport effects. The solutions for the HI and H$_2$ density profiles and the integrated HI columns, depend primarily on the ratios $I_{\rm UV}/Rn$ and $\zeta/Rn$, where $I_{\rm UV}$ is the intensity of the photodissociating FUV field, $\zeta$ is the H$_2$ cosmic-ray ionization rate, $n$ is the hydrogen gas density, and $R$ is the dust-surface H$_2$ formation rate coefficient. We present computations for a wide range of FUV field strengths, cosmic-ray ionization rates, and dust-to-gas ratios. We develop analytic expressions for the growth of the HI column densities. For Galactic giant molecular clouds (GMCs) with multiphased (warm/cold) HI envelopes, the interior cosmic-ray zones will dominate the production of the HI only if $\zeta \gtrsim 4.5\times 10^{-16} \times (M_{\rm GMC}/10^6 \ M_{\odot})^{-1/2}$~s$^{-1}$, where $M_{\rm GMC}$ is the GMC mass, and including attenuation of the cosmic-ray fluxes. For most Galactic GMCs and conditions, FUV photodissociation dominates over cosmic-ray ionization for the production of the HI column densities. Furthermore, the cosmic-rays do not affect the HI-to-H$_2$ transition points.


title: Spanning Adjacency Oracles in Sublinear Time

abstract: Suppose we are given an $n$-node, $m$-edge input graph $G$, and the goal is to compute a spanning subgraph $H$ on $O(n)$ edges. This can be achieved in linear $O(m + n)$ time via breadth-first search. But can we hope for \emph{sublinear} runtime in some range of parameters? If the goal is to return $H$ as an adjacency list, there are simple lower bounds showing that $\Omega(m + n)$ runtime is necessary. If the goal is to return $H$ as an adjacency matrix, then we need $\Omega(n^2)$ time just to write down the entries of the output matrix. However, we show that neither of these lower bounds still apply if instead the goal is to return $H$ as an \emph{implicit} adjacency matrix, which we call an \emph{adjacency oracle}. An adjacency oracle is a data structure that gives a user the illusion that an adjacency matrix has been computed: it accepts edge queries $(u, v)$, and it returns in near-constant time a bit indicating whether $(u, v) \in E(H)$. Our main result is that one can construct an adjacency oracle for a spanning subgraph on at most $(1+\varepsilon)n$ edges, in $\tilde{O}(n \varepsilon^{-1})$ time, and that this construction time is near-optimal. Additional results include constructions of adjacency oracles for $k$-connectivity certificates and spanners, which are similarly sublinear on dense-enough input graphs. Our adjacency oracles are closely related to Local Computation Algorithms (LCAs) for graph sparsifiers; they can be viewed as LCAs with some computation moved to a preprocessing step, in order to speed up queries. Our oracles imply the first Local algorithm for computing sparse spanning subgraphs of general input graphs in $\tilde{O}(n)$ query time, which works by constructing our adjacency oracle, querying it once, and then throwing the rest of the oracle away. This addresses an open problem of Rubinfeld [CSR '17].


title: Drug Interaction Vectors Neural Network: DrIVeNN

abstract: Polypharmacy, the concurrent use of multiple drugs to treat a single condition, is common in patients managing multiple or complex conditions. However, as more drugs are added to the treatment plan, the risk of adverse drug events (ADEs) rises rapidly. Many serious ADEs associated with polypharmacy only become known after the drugs are in use. It is impractical to test every possible drug combination during clinical trials. This issue is particularly prevalent among older adults with cardiovascular disease (CVD) where polypharmacy and ADEs are commonly observed. In this research, our primary objective was to identify key drug features to build and evaluate a model for modeling polypharmacy ADEs. Our secondary objective was to assess our model on a domain-specific case study. We developed a two-layer neural network that incorporated drug features such as molecular structure, drug-protein interactions, and mono drug side effects (DrIVeNN). We assessed DrIVeNN using publicly available side effect databases and determined Principal Component Analysis (PCA) with a variance threshold of 0.95 as the most effective feature selection method. DrIVeNN performed moderately better than state-of-the-art models like RESCAL, DEDICOM, DeepWalk, Decagon, DeepDDI, KGDDI, and KGNN in terms of AUROC for the drug-drug interaction prediction task. We also conducted a domain-specific case study centered on the treatment of cardiovascular disease (CVD). When the best performing model architecture was applied to the CVD treatment cohort, there was a significant increase in performance from the general model. We observed an average AUROC for CVD drug pair prediction increasing from 0.826 (general model) to 0.975 (CVD specific model). Our findings indicate the strong potential of domain-specific models for improving the accuracy of drug-drug interaction predictions.


title: Towards Real Time Egocentric Segment Captioning for The Blind and Visually Impaired in RGB-D Theatre Images

abstract: In recent years, image captioning and segmentation have emerged as crucial tasks in computer vision, with applications ranging from autonomous driving to content analysis. Although multiple solutions have emerged to help blind and visually impaired people move around their environment, few are applications that help them understand and rebuild a scene in their minds through text. Most built models focus on helping users move and avoid obstacles, restricting the number of environments blind and visually impaired people can be in. In this paper, we will propose an approach that helps them understand their surroundings using image captioning. The particularity of our research is that we offer them descriptions with positions of regions and objects regarding them (left, right, front), as well as positional relationships between regions, while we aim to give them access to theatre plays by applying the solution to our TS-RGBD dataset.


title: Unsupervised Domain Adaptation via Domain-Adaptive Diffusion

abstract: Unsupervised Domain Adaptation (UDA) is quite challenging due to the large distribution discrepancy between the source domain and the target domain. Inspired by diffusion models which have strong capability to gradually convert data distributions across a large gap, we consider to explore the diffusion technique to handle the challenging UDA task. However, using diffusion models to convert data distribution across different domains is a non-trivial problem as the standard diffusion models generally perform conversion from the Gaussian distribution instead of from a specific domain distribution. Besides, during the conversion, the semantics of the source-domain data needs to be preserved for classification in the target domain. To tackle these problems, we propose a novel Domain-Adaptive Diffusion (DAD) module accompanied by a Mutual Learning Strategy (MLS), which can gradually convert data distribution from the source domain to the target domain while enabling the classification model to learn along the domain transition process. Consequently, our method successfully eases the challenge of UDA by decomposing the large domain gap into small ones and gradually enhancing the capacity of classification model to finally adapt to the target domain. Our method outperforms the current state-of-the-arts by a large margin on three widely used UDA datasets.


title: FwdLLM: Efficient FedLLM using Forward Gradient

abstract: Large Language Models (LLMs) are transforming the landscape of mobile intelligence. Federated Learning (FL), a method to preserve user data privacy, is often employed in fine-tuning LLMs to downstream mobile tasks, an approach known as FedLLM. Though recent efforts have addressed the network issue induced by the vast model size, they have not practically mitigated vital challenges concerning integration with mobile devices, such as significant memory consumption and sluggish model convergence. In response to these challenges, this work introduces FwdLLM, an innovative FL protocol designed to enhance the FedLLM efficiency. The key idea of FwdLLM to employ backpropagation (BP)-free training methods, requiring devices only to execute ``perturbed inferences''. Consequently, FwdLLM delivers way better memory efficiency and time efficiency (expedited by mobile NPUs and an expanded array of participant devices). FwdLLM centers around three key designs: (1) it combines BP-free training with parameter-efficient training methods, an essential way to scale the approach to the LLM era; (2) it systematically and adaptively allocates computational loads across devices, striking a careful balance between convergence speed and accuracy; (3) it discriminatively samples perturbed predictions that are more valuable to model convergence. Comprehensive experiments with five LLMs and three NLP tasks illustrate FwdLLM's significant advantages over conventional methods, including up to three orders of magnitude faster convergence and a 14.6x reduction in memory footprint. Uniquely, FwdLLM paves the way for federated learning of billion-parameter LLMs such as LLaMA on COTS mobile devices -- a feat previously unattained.


title: Estimating Changepoints in Extremal Dependence, Applied to Aviation Stock Prices During COVID-19 Pandemic

abstract: The dependence in the tails of the joint distribution of two random variables is generally assessed using $\chi$-measure, the limiting conditional probability of one variable being extremely high given the other variable is also extremely high. This work is motivated by the structural changes in $\chi$-measure between the daily rate of return (RoR) of the two Indian airlines, IndiGo and SpiceJet, during the COVID-19 pandemic. We model the daily maximum and minimum RoR vectors (potentially transformed) using the bivariate H\"usler-Reiss (BHR) distribution. To estimate the changepoint in the $\chi$-measure of the BHR distribution, we explore two changepoint detection procedures based on the Likelihood Ratio Test (LRT) and Modified Information Criterion (MIC). We obtain critical values and power curves of the LRT and MIC test statistics for low through high values of $\chi$-measure. We also explore the consistency of the estimators of the changepoint based on LRT and MIC numerically. In our data application, for RoR maxima and minima, the most prominent changepoints detected by LRT and MIC are close to the announcement of the first phases of lockdown and unlock, respectively, which are realistic; thus, our study would be beneficial for portfolio optimization in the case of future pandemic situations.


title: Establishing connection between neutron star properties and nuclear matter parameters through a comprehensive multivariate analysis

abstract: We have attempted to mitigate the challenge of connecting the neutron star (NS) properties with the nuclear matter parameters that describe equations of state (EoSs). The efforts to correlate various neutron star properties with individual nuclear matter parameters have been inconclusive. A Principal Component Analysis is employed as a tool to uncover the connection between multiple nuclear matter parameters and the tidal deformability as well as the radius of neutron stars within the mass range of $1.2-1.8M_\odot$. The essential EOSs for neutron star matter at low densities have been derived using both uncorrelated uniform distributions and minimally constrained joint posterior distributions of nuclear matter parameters. For higher densities ($\rho > 0.32$fm$^{-3}$), the EOSs have been established through a suitable parameterization of the speed of sound, which consistently maintains causality and gradually approaches the conformal limit. Our analysis reveals that in order to account for over 90\% of the variability in NS properties, it is crucial to consider two or more principal components, emphasizing the significance of employing multivariate analysis. To explain the variability in tidal deformability needs a greater number of principal components compared to those for the radius at a given NS mass. The contributions from iso-vector nuclear matter parameters to the tidal deformability and radius of NS decrease by $\sim$ 25\% with the increase in mass of NS from 1.2$M_\odot$ to 1.8$M_\odot$.


title: InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules

abstract: Generalizing Neural Radiance Fields (NeRF) to new scenes is a significant challenge that existing approaches struggle to address without extensive modifications to vanilla NeRF framework. We introduce InsertNeRF, a method for INStilling gEneRalizabiliTy into NeRF. By utilizing multiple plug-and-play HyperNet modules, InsertNeRF dynamically tailors NeRF's weights to specific reference scenes, transforming multi-scale sampling-aware features into scene-specific representations. This novel design allows for more accurate and efficient representations of complex appearances and geometries. Experiments show that this method not only achieves superior generalization performance but also provides a flexible pathway for integration with other NeRF-like systems, even in sparse input settings. Code will be available https://github.com/bbbbby-99/InsertNeRF.


title: Memory-aware Scheduling for Complex Wired Networks with Iterative Graph Optimization

abstract: Memory-aware network scheduling is becoming increasingly important for deep neural network (DNN) inference on resource-constrained devices. However, due to the complex cell-level and network-level topologies, memory-aware scheduling becomes very challenging. While previous algorithms all suffer from poor scalability, in this paper, we propose an efficient memory-aware scheduling framework based on iterative computation graph optimization. Our framework features an iterative graph fusion algorithm that simplifies the computation graph while preserving the scheduling optimality. We further propose an integer linear programming formulation together with topology-aware variable pruning to schedule the simplified graph efficiently. We evaluate our method against prior-art algorithms on different networks and demonstrate that our method outperforms existing techniques in all the benchmarks, reducing the peak memory footprint by 13.4%, and achieving better scalability for networks with complex network-level topologies.


title: Self-Enforced Job Matching

abstract: The classic two-sided many-to-one job matching model assumes that firms treat workers as substitutes and workers ignore colleagues when choosing where to work. Relaxing these assumptions may lead to nonexistence of stable matchings. However, matching is often not a static allocation, but an ongoing process with long-lived firms and short-lived workers. We show that stability is always guaranteed dynamically when firms are patient, even with complementarities in firm technologies and peer effects in worker preferences. While no-poaching agreements are anti-competitive, they can maintain dynamic stability in markets that are otherwise unstable, which may contribute to their prevalence in labor markets.


title: Semi-Supervised Semantic Segmentation via Marginal Contextual Information

abstract: We present a novel confidence refinement scheme that enhances pseudo-labels in semi-supervised semantic segmentation. Unlike current leading methods, which filter pixels with low-confidence predictions in isolation, our approach leverages the spatial correlation of labels in segmentation maps by grouping neighboring pixels and considering their pseudo-labels collectively. With this contextual information, our method, named S4MC, increases the amount of unlabeled data used during training while maintaining the quality of the pseudo-labels, all with negligible computational overhead. Through extensive experiments on standard benchmarks, we demonstrate that S4MC outperforms existing state-of-the-art semi-supervised learning approaches, offering a promising solution for reducing the cost of acquiring dense annotations. For example, S4MC achieves a 1.29 mIoU improvement over the prior state-of-the-art method on PASCAL VOC 12 with 366 annotated images. The code to reproduce our experiments is available at https://s4mcontext.github.io/


title: Exploring Tidal Force Effects and Shadow Constraints for Schwarzschild-like Black Hole in Starobinsky-Bel-Robinson Gravity

abstract: The current manuscript deals with the tidal force effects, geodesic deviation, and shadow constraints of the Schwarzschild-like black hole theorised in Starobinsky-Bel-Robinson gravity exhibiting M-theory compactification. In the current analysis, we explore the radial and angular tidal force effects on a radially in-falling particle by the central black hole, which is located in this spacetime. We also numerically solve the geodesic deviation equation and study the variation of the geodesic separation vector with the radial coordinate for two nearby geodesics using suitable initial conditions. All the obtained results are tested for Sag A* and M87* by constraining the value of the stringy gravity parameter $\beta$ using the shadow data from the event horizon telescope observations. All the results are compared with Schwarzschild black hole spacetime. In our study, we found that both the radial and angular tidal forces experienced by a particle switch their initial behaviour and turn compressive and stretching, respectively, before reaching the event horizon. The geodesic deviation shows an oscillating trend as well for the chosen initial condition. For the constrained value of $\beta$, we see that the spacetime geometry generated by Sag A* and M87* is effectively same for both Schwarzschild and Starobinsky-Bel-Robinson black hole. Furthermore, we also calculated the angular diameter of the shadow in Starobinsky-Bel-Robinson black hole and compared with the Schwarzschild black hole. It is observed that the angular diameter of shadow for M87* and Sgr A* in Starobinsky-Bel-Robinson black hole is smaller than the Schwarzschild black hole. The calculated results satisfy the event horizon telescope observational constraints. Finally, we have concluding remarks.


title: Spurious-Free Lithium Niobate Bulk Acoustic Resonator for Piezoelectric Power Conversion

abstract: Recently, piezoelectric power conversion has shown great benefits from replacing the bulky and lossy magnetic inductor in a traditional power converter with a piezoelectric resonator due to its compact size and low loss. However, the converter performance is ultimately limited by existing resonator designs, specifically by moderate quality factor (Q), moderate electromechanical coupling (kt2), and spurious modes near resonance. This work reports a spurious-free lithium niobate (LiNbO3) thickness-extensional mode bulk acoustic resonator design, demonstrating Q of 4000 and kt2 of 30% with a fractional suppressed region of 62%. We first propose a novel grounded ring structure for spurious-free resonator design, then validate its performance experimentally. Upon further work, this design could be extended to applications requiring spurious suppression, such as filters, tunable oscillators, transformers, etc.


title: Disjoint Pose and Shape for 3D Face Reconstruction

abstract: Existing methods for 3D face reconstruction from a few casually captured images employ deep learning based models along with a 3D Morphable Model(3DMM) as face geometry prior. Structure From Motion(SFM), followed by Multi-View Stereo (MVS), on the other hand, uses dozens of high-resolution images to reconstruct accurate 3D faces.However, it produces noisy and stretched-out results with only two views available. In this paper, taking inspiration from both these methods, we propose an end-to-end pipeline that disjointly solves for pose and shape to make the optimization stable and accurate. We use a face shape prior to estimate face pose and use stereo matching followed by a 3DMM to solve for the shape. The proposed method achieves end-to-end topological consistency, enables iterative face pose refinement procedure, and show remarkable improvement on both quantitative and qualitative results over existing state-of-the-art methods.


title: LMSanitator: Defending Prompt-Tuning Against Task-Agnostic Backdoors

abstract: Prompt-tuning has emerged as an attractive paradigm for deploying large-scale language models due to its strong downstream task performance and efficient multitask serving ability. Despite its wide adoption, we empirically show that prompt-tuning is vulnerable to downstream task-agnostic backdoors, which reside in the pretrained models and can affect arbitrary downstream tasks. The state-of-the-art backdoor detection approaches cannot defend against task-agnostic backdoors since they hardly converge in reversing the backdoor triggers. To address this issue, we propose LMSanitator, a novel approach for detecting and removing task-agnostic backdoors on Transformer models. Instead of directly inverting the triggers, LMSanitator aims to invert the predefined attack vectors (pretrained models' output when the input is embedded with triggers) of the task-agnostic backdoors, which achieves much better convergence performance and backdoor detection accuracy. LMSanitator further leverages prompt-tuning's property of freezing the pretrained model to perform accurate and fast output monitoring and input purging during the inference phase. Extensive experiments on multiple language models and NLP tasks illustrate the effectiveness of LMSanitator. For instance, LMSanitator achieves 92.8% backdoor detection accuracy on 960 models and decreases the attack success rate to less than 1% in most scenarios.


title: Estimation and Hypothesis Testing of Derivatives in Smoothing Spline ANOVA Models

abstract: This article studies the derivatives in models that flexibly characterize the relationship between a response variable and multiple predictors, with goals of providing both accurate estimation and inference procedures for hypothesis testing. In the setting of tensor product reproducing spaces for nonparametric multivariate functions, we propose a plug-in kernel ridge regression estimator to estimate the derivatives of the underlying multivariate regression function under the smoothing spline ANOVA model. This estimator has an analytical form, making it simple to implement in practice. We first establish $L_\infty$ and $L_2$ convergence rates of the proposed estimator under general random designs. For derivatives with some selected interesting orders, we provide an in-depth analysis establishing the minimax lower bound, which matches the $L_2$ convergence rate. Additionally, motivated by a wide range of applications, we propose a hypothesis testing procedure to examine whether a derivative is zero. Theoretical results demonstrate that the proposed testing procedure achieves the correct size under the null hypothesis and is asymptotically powerful under local alternatives. For ease of use, we also develop an associated bootstrap algorithm to construct the rejection region and calculate the p-value, and the consistency of the proposed algorithm is established. Simulation studies using synthetic data and an application to a real-world dataset confirm the effectiveness of our methods.


title: A Two-Dimensional Deep Network for RF-based Drone Detection and Identification Towards Secure Coverage Extension

abstract: As drones become increasingly prevalent in human life, they also raises security concerns such as unauthorized access and control, as well as collisions and interference with manned aircraft. Therefore, ensuring the ability to accurately detect and identify between different drones holds significant implications for coverage extension. Assisted by machine learning, radio frequency (RF) detection can recognize the type and flight mode of drones based on the sampled drone signals. In this paper, we first utilize Short-Time Fourier. Transform (STFT) to extract two-dimensional features from the raw signals, which contain both time-domain and frequency-domain information. Then, we employ a Convolutional Neural Network (CNN) built with ResNet structure to achieve multi-class classifications. Our experimental results show that the proposed ResNet-STFT can achieve higher accuracy and faster convergence on the extended dataset. Additionally, it exhibits balanced performance compared to other baselines on the raw dataset.


title: On the non-commutative Neveu decomposition and stochastic ergodic theorems

abstract: In this article, we prove Neveu decomposition for the action of the locally compact amenable semigroup of positive contractions on semifinite von Neumann algebras and thus, it entirely resolves the problem for the actions of arbitrary amenable semigroup on semifinite von Neumann algebras. We also prove it for amenable group actions by Markov automorphisms on any $\sigma$-finite von Neumann algebras. As an application, we obtain stochastic ergodic theorem for actions of $ \mathbb{Z}_+^d$ and $\mathbb{R}_+^d$ for $ d \in \mathbb{N}$ by positive contractions on $L^1$-spaces associated with a finite von Neumann algebra. It yields the first ergodic theorem for positive contraction on non-commutative $L^1$-spaces beyond the Danford-Schwartz category.


title: Sparse Recovery with Attention: A Hybrid Data/Model Driven Solution for High Accuracy Position and Channel Tracking at mmWave

abstract: In this paper, we propose first a mmWave channel tracking algorithm based on multidimensional orthogonal matching pursuit algorithm (MOMP) using reduced sparsifying dictionaries, which exploits information from channel estimates in previous frames. Then, we present an algorithm to obtain the vehicle's initial location for the current frame by solving a system of geometric equations that leverage the estimated path parameters. Next, we design an attention network that analyzes the series of channel estimates, the vehicle's trajectory, and the initial estimate of the position associated with the current frame, to generate a refined, high accuracy position estimate. The proposed system is evaluated through numerical experiments using realistic mmWave channel series generated by ray-tracing. The experimental results show that our system provides a 2D position tracking error below 20 cm, significantly outperforming previous work based on Bayesian filtering.


title: Role of Dilations in Reversing Physical Processes: Tabletop Reversibility and Generalized Thermal Operations

abstract: Irreversibility, crucial in both thermodynamics and information theory, is naturally studied by comparing the evolution -- the (forward) channel -- with an associated reverse -- the reverse channel. There are two natural ways to define this reverse channel. Using logical inference, the reverse channel is the Bayesian retrodiction (the Petz recovery map in the quantum formalism) of the original one. Alternatively, we know from physics that every irreversible process can be modeled as an open system: one can then define the corresponding closed system by adding a bath ("dilation"), trivially reverse the global reversible process, and finally remove the bath again. We prove that the two recipes are strictly identical, both in the classical and in the quantum formalism, once one accounts for correlations formed between system and the bath. Having established this, we define and study special classes of maps: product-preserving maps (including generalized thermal maps), for which no such system-bath correlations are formed for some states; and tabletop time-reversible maps, when the reverse channel can be implemented with the same devices as the original one. We establish several general results connecting these classes, and a very detailed characterization when both the system and the bath are one qubit. In particular, we show that when reverse channels are well-defined, product-preservation is a sufficient but not necessary condition for tabletop reversibility; and that the preservation of local energy spectra is a necessary and sufficient condition to generalized thermal operations.


title: Exploring Human Crowd Patterns and Categorization in Video Footage for Enhanced Security and Surveillance using Computer Vision and Machine Learning

abstract: Computer vision and machine learning have brought revolutionary shifts in perception for researchers, scientists, and the general populace. Once thought to be unattainable, these technologies have achieved the seemingly impossible. Their exceptional applications in diverse fields like security, agriculture, and education are a testament to their impact. However, the full potential of computer vision remains untapped. This paper explores computer vision's potential in security and surveillance, presenting a novel approach to track motion in videos. By categorizing motion into Arcs, Lanes, Converging/Diverging, and Random/Block motions using Motion Information Images and Blockwise dominant motion data, the paper examines different optical flow techniques, CNN models, and machine learning models. Successfully achieving its objectives with promising accuracy, the results can train anomaly-detection models, provide behavioral insights based on motion, and enhance scene comprehension.


title: A Wide Evaluation of ChatGPT on Affective Computing Tasks

abstract: With the rise of foundation models, a new artificial intelligence paradigm has emerged, by simply using general purpose foundation models with prompting to solve problems instead of training a separate machine learning model for each problem. Such models have been shown to have emergent properties of solving problems that they were not initially trained on. The studies for the effectiveness of such models are still quite limited. In this work, we widely study the capabilities of the ChatGPT models, namely GPT-4 and GPT-3.5, on 13 affective computing problems, namely aspect extraction, aspect polarity classification, opinion extraction, sentiment analysis, sentiment intensity ranking, emotions intensity ranking, suicide tendency detection, toxicity detection, well-being assessment, engagement measurement, personality assessment, sarcasm detection, and subjectivity detection. We introduce a framework to evaluate the ChatGPT models on regression-based problems, such as intensity ranking problems, by modelling them as pairwise ranking classification. We compare ChatGPT against more traditional NLP methods, such as end-to-end recurrent neural networks and transformers. The results demonstrate the emergent abilities of the ChatGPT models on a wide range of affective computing problems, where GPT-3.5 and especially GPT-4 have shown strong performance on many problems, particularly the ones related to sentiment, emotions, or toxicity. The ChatGPT models fell short for problems with implicit signals, such as engagement measurement and subjectivity detection.


title: Multi-level Operation of FeFETs Memristors: the Crucial Role of Three Dimensional Effects

abstract: This paper investigates and compares through a comprehensive TCAD analysis 2D and 3D simulations for ferroelectric based FETs. We provide clear evidence that the multiple read conductance values experimentally observed in FeFETs stem from source to drain percolation current paths, which are governed by the polarization patterns in the ferroelectric domains. Such a physical picture makes 3D simulations indispensable to capture even the qualitative features of the device behaviour, not to mention the quantitative aspects.


title: Spectral Theory of Isogeny Graphs

abstract: We consider finite graphs whose vertexes are supersingular elliptic curves, possibly with level structure, and edges are isogenies. They can be applied to the study of modular forms and to isogeny based cryptography. The main result of this paper says that these graphs have the Ramanujan property, which means that the eigenvalues of their adjacency matrices are as small as possible. We also study the asymptotic distribution of the eigenvalues of the adjacency matrices, the number of connected components, the automorphisms of the graphs, and the connection between the graphs and modular forms.


title: Hellmann Feynman Theorem in Non-Hermitian system

abstract: We revisit the celebrated Hellmann-Feynman theorem (HFT) in the PT invariant non-Hermitian quantum physics framework. We derive a modified version of HFT by changing the definition of inner product and explicitly show that it holds good for both PT broken, unbroken phases and even at the exceptional point of the theory. The derivation is extremely general and works for even PT non-invariant Hamiltonian. We consider several examples of discrete and continuum systems to test our results. We find that if the eigenvalue goes through a real to complex transition as a function of the Hermiticity breaking parameter, both sides of the modified HFT expression diverge at that point. If that point turns out to be an EP of the PT invariant quantum theory, then one also sees the divergence at EP. Finally, we also derive a generalized Virial theorem for non-Hermitian systems using the modified HFT, which potentially can be tested in experiments.

categories: quant-ph cond-mat.other hep-th math-ph math.MP


title: Break-Point Date Estimation for Nonstationary Autoregressive and Predictive Regression Models

abstract: In this article, we study the statistical and asymptotic properties of break-point estimators in nonstationary autoregressive and predictive regression models for testing the presence of a single structural break at an unknown location in the full sample. Moreover, we investigate aspects such as how the persistence properties of covariates and the location of the break-point affects the limiting distribution of the proposed break-point estimators.


title: Exploring Large Language Models for Knowledge Graph Completion

abstract: Knowledge graphs play a vital role in numerous artificial intelligence tasks, yet they frequently face the issue of incompleteness. In this study, we explore utilizing Large Language Models (LLM) for knowledge graph completion. We consider triples in knowledge graphs as text sequences and introduce an innovative framework called Knowledge Graph LLM (KG-LLM) to model these triples. Our technique employs entity and relation descriptions of a triple as prompts and utilizes the response for predictions. Experiments on various benchmark knowledge graphs demonstrate that our method attains state-of-the-art performance in tasks such as triple classification and relation prediction. We also find that fine-tuning relatively smaller models (e.g., LLaMA-7B, ChatGLM-6B) outperforms recent ChatGPT and GPT-4.


title: Transfer Learning for Microstructure Segmentation with CS-UNet: A Hybrid Algorithm with Transformer and CNN Encoders

abstract: Transfer learning improves the performance of deep learning models by initializing them with parameters pre-trained on larger datasets. Intuitively, transfer learning is more effective when pre-training is on the in-domain datasets. A recent study by NASA has demonstrated that the microstructure segmentation with encoder-decoder algorithms benefits more from CNN encoders pre-trained on microscopy images than from those pre-trained on natural images. However, CNN models only capture the local spatial relations in images. In recent years, attention networks such as Transformers are increasingly used in image analysis to capture the long-range relations between pixels. In this study, we compare the segmentation performance of Transformer and CNN models pre-trained on microscopy images with those pre-trained on natural images. Our result partially confirms the NASA study that the segmentation performance of out-of-distribution images (taken under different imaging and sample conditions) is significantly improved when pre-training on microscopy images. However, the performance gain for one-shot and few-shot learning is more modest with Transformers. We also find that for image segmentation, the combination of pre-trained Transformers and CNN encoders are consistently better than pre-trained CNN encoders alone. Our dataset (of about 50,000 images) combines the public portion of the NASA dataset with additional images we collected. Even with much less training data, our pre-trained models have significantly better performance for image segmentation. This result suggests that Transformers and CNN complement each other and when pre-trained on microscopy images, they are more beneficial to the downstream tasks.


title: The simpliciality of higher-order networks

abstract: Higher-order networks are widely used to describe complex systems in which interactions can involve more than two entities at once. In this paper, we focus on inclusion within higher-order networks, referring to situations where specific entities participate in an interaction, and subsets of those entities also interact with each other. Traditional modeling approaches to higher-order networks tend to either not consider inclusion at all (e.g., hypergraph models) or explicitly assume perfect and complete inclusion (e.g., simplicial complex models). To allow for a more nuanced assessment of inclusion in higher-order networks, we introduce the concept of "simpliciality" and several corresponding measures. Contrary to current modeling practice, we show that empirically observed systems rarely lie at either end of the simpliciality spectrum. In addition, we show that generative models fitted to these datasets struggle to capture their inclusion structure. These findings suggest new modeling directions for the field of higher-order network science.


title: Random Projection using Random Quantum Circuits

abstract: The random sampling task performed by Google's Sycamore processor gave us a glimpse of the "Quantum Supremacy era". This has definitely shed some spotlight on the power of random quantum circuits in this abstract task of sampling outputs from the (pseudo-) random circuits. In this manuscript, we explore a practical near-term use of local random quantum circuits in dimensional reduction of large low-rank data sets. We make use of the well-studied dimensionality reduction technique called the random projection method. This method has been extensively used in various applications such as image processing, logistic regression, entropy computation of low-rank matrices, etc. We prove that the matrix representations of local random quantum circuits with sufficiently shorter depths ($\sim O(n)$) serve as good candidates for random projection. We demonstrate numerically that their projection abilities are not far off from the computationally expensive classical principal components analysis on MNIST and CIFAR-100 image data sets. We also benchmark the performance of quantum random projection against the commonly used classical random projection in the tasks of dimensionality reduction of image datasets and computing Von Neumann entropies of large low-rank density matrices. And finally using variational quantum singular value decomposition, we demonstrate a near-term implementation of extracting the singular vectors with dominant singular values after quantum random projecting a large low-rank matrix to lower dimensions. All such numerical experiments unequivocally demonstrate the ability of local random circuits to randomize a large Hilbert space at sufficiently shorter depths with robust retention of properties of large datasets in reduced dimensions.


title: Modeling Programmer Attention as Scanpath Prediction

abstract: This paper launches a new effort at modeling programmer attention by predicting eye movement scanpaths. Programmer attention refers to what information people intake when performing programming tasks. Models of programmer attention refer to machine prediction of what information is important to people. Models of programmer attention are important because they help researchers build better interfaces, assistive technologies, and more human-like AI. For many years, researchers in SE have built these models based on features such as mouse clicks, key logging, and IDE interactions. Yet the holy grail in this area is scanpath prediction -- the prediction of the sequence of eye fixations a person would take over a visual stimulus. A person's eye movements are considered the most concrete evidence that a person is taking in a piece of information. Scanpath prediction is a notoriously difficult problem, but we believe that the emergence of lower-cost, higher-accuracy eye tracking equipment and better large language models of source code brings a solution within grasp. We present an eye tracking experiment with 27 programmers and a prototype scanpath predictor to present preliminary results and obtain early community feedback.