title: Experimenting with Self-Supervision using Rotation Prediction for Image Captioning

abstract: Image captioning is a task in the field of Artificial Intelligence that merges between computer vision and natural language processing. It is responsible for generating legends that describe images, and has various applications like descriptions used by assistive technology or indexing images (for search engines for instance). This makes it a crucial topic in AI that is undergoing a lot of research. This task however, like many others, is trained on large images labeled via human annotation, which can be very cumbersome: it needs manual effort, both financial and temporal costs, it is error-prone and potentially difficult to execute in some cases (e.g. medical images). To mitigate the need for labels, we attempt to use self-supervised learning, a type of learning where models use the data contained within the images themselves as labels. It is challenging to accomplish though, since the task is two-fold: the images and captions come from two different modalities and usually handled by different types of networks. It is thus not obvious what a completely self-supervised solution would look like. How it would achieve captioning in a comparable way to how self-supervision is applied today on image recognition tasks is still an ongoing research topic. In this project, we are using an encoder-decoder architecture where the encoder is a convolutional neural network (CNN) trained on OpenImages dataset and learns image features in a self-supervised fashion using the rotation pretext task. The decoder is a Long Short-Term Memory (LSTM), and it is trained, along within the image captioning model, on MS COCO dataset and is responsible of generating captions. Our GitHub repository can be found: https://github.com/elhagry1/SSL_ImageCaptioning_RotationPrediction


title: Probing superheavy dark matter with gravitational waves

abstract: We study the superheavy dark matter (DM) scenario in an extended $B-L$ model, where one generation of right-handed neutrino $\nu_R$ is the DM candidate. If there is a new lighter sterile neutrino that co-annihilate with the DM candidate, then the annihilation rate is exponentially enhanced, allowing a DM mass much heavier than the Griest-Kamionkowski bound ($\sim10^5$ GeV). We demonstrate that a DM mass $M_{\nu_R}\gtrsim10^{13}$ GeV can be achieved. Although beyond the scale of any traditional DM searching strategy, this scenario is testable via gravitational waves (GWs) emitted by the cosmic strings from the $U(1)_{B-L}$ breaking. Quantitative calculations show that the DM mass $\mathcal{O}(10^9-10^{13}~{\rm GeV})$ can be probed by future GW detectors.


title: Algorithm for removing secondary lines blended with Balmer lines in synthetic spectra of massive stars

abstract: In order to measure automatically the equivalent width of the Balmer lines in a database of 40,000 atmosphere models, we have developed a program that mimics the work of an astronomer in terms of identifying and eliminating secondary spectral lines mixed with the Balmer lines. The equivalent widths measured have average errors of 5 percent, which makes them very reliable. As part of the FITspec code, this program improves the automatic adjustment of an atmosphere model to the observed spectrum of a massive star.


title: A Thorough Review on Recent Deep Learning Methodologies for Image Captioning

abstract: Image Captioning is a task that combines computer vision and natural language processing, where it aims to generate descriptive legends for images. It is a two-fold process relying on accurate image understanding and correct language understanding both syntactically and semantically. It is becoming increasingly difficult to keep up with the latest research and findings in the field of image captioning due to the growing amount of knowledge available on the topic. There is not, however, enough coverage of those findings in the available review papers. We perform in this paper a run-through of the current techniques, datasets, benchmarks and evaluation metrics used in image captioning. The current research on the field is mostly focused on deep learning-based methods, where attention mechanisms along with deep reinforcement and adversarial learning appear to be in the forefront of this research topic. In this paper, we review recent methodologies such as UpDown, OSCAR, VIVO, Meta Learning and a model that uses conditional generative adversarial nets. Although the GAN-based model achieves the highest score, UpDown represents an important basis for image captioning and OSCAR and VIVO are more useful as they use novel object captioning. This review paper serves as a roadmap for researchers to keep up to date with the latest contributions made in the field of image caption generation.


title: An Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregivers

abstract: With the advent of off-the-shelf intelligent home products and broader internet adoption, researchers increasingly explore smart computing applications that provide easier access to health and wellness resources. AI-based systems like chatbots have the potential to provide services that could provide mental health support. However, existing therapy chatbots are often retrieval-based, requiring users to respond with a constrained set of answers, which may not be appropriate given that such pre-determined inquiries may not reflect each patient's unique circumstances. Generative-based approaches, such as the OpenAI GPT models, could allow for more dynamic conversations in therapy chatbot contexts than previous approaches. To investigate the generative-based model's potential in therapy chatbot contexts, we built a chatbot using the GPT-2 model. We fine-tuned it with 306 therapy session transcripts between family caregivers of individuals with dementia and therapists conducting Problem Solving Therapy. We then evaluated the model's pre-trained and the fine-tuned model in terms of basic qualities using three meta-information measurements: the proportion of non-word outputs, the length of response, and sentiment components. Results showed that: (1) the fine-tuned model created more non-word outputs than the pre-trained model; (2) the fine-tuned model generated outputs whose length was more similar to that of the therapists compared to the pre-trained model; (3) both the pre-trained model and fine-tuned model were likely to generate more negative and fewer positive outputs than the therapists. We discuss potential reasons for the problem, the implications, and solutions for developing therapy chatbots and call for investigations of the AI-based system application.


title: Protein-protein interactions enhance the thermal resilience of SpyRing enzymes: a molecular dynamic simulation study

abstract: Recently a technique based on the interaction between adhesion proteins extracted from Streptococcus pyogenes, known as SpyRing, has been widely used to improve the thermal resilience of enzymes, the assembly of biostructures, cancer cell recognition and other fields. In SpyRing, the two termini of the target enzyme are respectively linked to the peptide SpyTag and its protein partner SpyCatcher. SpyTag spontaneously reacts with SpyCatcher to form an isopeptide bond, with which the target enzyme forms a close ring structure. It was believed that the covalent cyclization of protein skeleton caused by SpyRing reduces the conformational entropy of biological structure and improves its rigidity, thus improving the thermal resilience of the target enzyme. However, the effects of SpyTag/ SpyCatcher interaction with this enzyme are poorly understood, and their regulation of enzyme properties remains unclear. Here, for simplicity, we took the single domain enzyme lichenase from Bacillus subtilis 168 as an example, studied the interface interactions in the SpyRing system by molecular dynamics simulations, and examined the effects of the changes of electrostatic interaction and van der Waals interaction on the thermal resilience of target enzyme. The simulations showed that the interface between SpyTag/SpyCatcher and lichenase is different from that found by geometric matching method and highlighted key mutations that affect the intensity of interactions at the interface and might have effect on the thermal resilience of the enzyme. Our calculations provided new insights into the rational designs in the SpyRing.


title: Image color correction, enhancement, and editing

abstract: This thesis presents methods and approaches to image color correction, color enhancement, and color editing. To begin, we study the color correction problem from the standpoint of the camera's image signal processor (ISP). A camera's ISP is hardware that applies a series of in-camera image processing and color manipulation steps, many of which are nonlinear in nature, to render the initial sensor image to its final photo-finished representation saved in the 8-bit standard RGB (sRGB) color space. As white balance (WB) is one of the major procedures applied by the ISP for color correction, this thesis presents two different methods for ISP white balancing. Afterward, we discuss another scenario of correcting and editing image colors, where we present a set of methods to correct and edit WB settings for images that have been improperly white-balanced by the ISP. Then, we explore another factor that has a significant impact on the quality of camera-rendered colors, in which we outline two different methods to correct exposure errors in camera-rendered images. Lastly, we discuss post-capture auto color editing and manipulation. In particular, we propose auto image recoloring methods to generate different realistic versions of the same camera-rendered image with new colors. Through extensive evaluations, we demonstrate that our methods provide superior solutions compared to existing alternatives targeting color correction, color enhancement, and color editing.


title: Divide-and-Assemble: Learning Block-wise Memory for Unsupervised Anomaly Detection

abstract: Reconstruction-based methods play an important role in unsupervised anomaly detection in images. Ideally, we expect a perfect reconstruction for normal samples and poor reconstruction for abnormal samples. Since the generalizability of deep neural networks is difficult to control, existing models such as autoencoder do not work well. In this work, we interpret the reconstruction of an image as a divide-and-assemble procedure. Surprisingly, by varying the granularity of division on feature maps, we are able to modulate the reconstruction capability of the model for both normal and abnormal samples. That is, finer granularity leads to better reconstruction, while coarser granularity leads to poorer reconstruction. With proper granularity, the gap between the reconstruction error of normal and abnormal samples can be maximized. The divide-and-assemble framework is implemented by embedding a novel multi-scale block-wise memory module into an autoencoder network. Besides, we introduce adversarial learning and explore the semantic latent representation of the discriminator, which improves the detection of subtle anomaly. We achieve state-of-the-art performance on the challenging MVTec AD dataset. Remarkably, we improve the vanilla autoencoder model by 10.1% in terms of the AUROC score.


title: Reinhardt cardinals in inner models

abstract: A cardinal is weakly Reinhardt if it is the critical point of an elementary embedding from the universe of sets into a model that contains the double powerset of every ordinal. This note establishes the equiconsistency of a proper class of weakly Reinhardt cardinals with a proper class of Reinhardt cardinals in the context of second-order set theory without the Axiom of Choice.


title: Combining physics-based modeling and deep learning for ultrasound elastography

abstract: Ultrasound elasticity images which enable the visualization of quantitative maps of tissue stiffness can be reconstructed by solving an inverse problem. Classical model-based approaches for ultrasound elastography use deterministic finite element methods (FEMs) to incorporate the governing physical laws resulting in poor performance in noisy conditions. Moreover, these approaches utilize fixed regularizers for various tissue patterns while appropriate data-adaptive priors might be required for capturing the complex spatial elasticity distribution. In this regard, we propose a joint model-based and learning-based framework for estimating the elasticity distribution by solving a regularized optimization problem. We present an integrated objective function composed of a statistical physics-based forward model and a data-driven regularizer to leverage deep neural networks for learning the underlying elasticity prior. This constrained optimization problem is solved using the gradient descent (GD) method and the gradient of regularizer is simply replaced by the residual of the trained denoiser network for having an explicit objective function with reduced computation time.


title: Learning Site-Specific Probing Beams for Fast mmWave Beam Alignment

abstract: Beam alignment - the process of finding an optimal directional beam pair - is a challenging procedure crucial to millimeter wave (mmWave) communication systems. We propose a novel beam alignment method that learns a site-specific probing codebook and uses the probing codebook measurements to predict the optimal narrow beam. An end-to-end neural network (NN) architecture is designed to jointly learn the probing codebook and the beam predictor. The learned codebook consists of site-specific probing beams that can capture particular characteristics of the propagation environment. The proposed method relies on beam sweeping of the learned probing codebook, does not require additional context information, and is compatible with the beam sweeping-based beam alignment framework in 5G. Using realistic ray-tracing datasets, we demonstrate that the proposed method can achieve high beam alignment accuracy and signal-to-noise ratio (SNR) while significantly - by roughly a factor of 3 in our setting - reducing the beam sweeping complexity and latency.


title: Subjective evaluation of traditional and learning-based image coding methods

abstract: We conduct a subjective experiment to compare the performance of traditional image coding methods and learning-based image coding methods. HEVC and VVC, the state-of-the-art traditional coding methods, are used as the representative traditional methods. The learning-based methods used contain not only CNN-based methods, but also a GAN-based method, all of which are advanced or typical. Single Stimuli (SS), which is also called Absolute Category Rating (ACR), is adopted as the methodology of the experiment to obtain perceptual quality of images. Additionally, we utilize some typical and frequently used objective quality metrics to evaluate the coding methods in the experiment as comparison. The experiment shows that CNN-based and GAN-based methods can perform better than traditional methods in low bit-rates. In high bit-rates, however, it is hard to verify whether CNN-based methods are superior to traditional methods. Because the GAN method does not provide models with high target bit-rates, we cannot exactly tell the performance of the GAN method in high bit-rates. Furthermore, some popular objective quality metrics have not shown the ability well to measure quality of images generated by learning-based coding methods, especially the GAN-based one.


title: No extremal square-free words over large alphabets

abstract: A word is square-free if it does not contain any square (a word of the form $XX$), and is extremal square-free if it cannot be extended to a new square-free word by inserting a single letter at any position. Grytczuk, Kordulewski, and Niewiadomski proved that there exist infinitely many ternary extremal square-free words. We establish that there are no extremal square-free words over any alphabet of size at least 17.


title: Robust and Active Learning for Deep Neural Network Regression

abstract: We describe a gradient-based method to discover local error maximizers of a deep neural network (DNN) used for regression, assuming the availability of an "oracle" capable of providing real-valued supervision (a regression target) for samples. For example, the oracle could be a numerical solver which, operationally, is much slower than the DNN. Given a discovered set of local error maximizers, the DNN is either fine-tuned or retrained in the manner of active learning.


title: On the vector conformal models in an arbitrary dimension

abstract: The conventional model of the gauge vector field is invariant under the local conformal symmetry only in the four-dimensional space ($4d$). Conformal generalization to an arbitrary dimension $d$ is impossible even for the free theory, differently from scalar and fermion fields. We discuss how to overcome this restriction and eventually construct four vector conformal actions. One of these models is the particular case of the previously known conformal theory of $n$-forms and others are new, up to our knowledge. In some of these models the gauge invariance is preserved, two of the new models are described by local actions with auxiliary compensating scalar fields, and the extended version of one of these models is on shell equivalent to the last, non-analytic, purely metric version.


title: Multipole decomposition of gravitational lensing

abstract: We study gravitational lensing by a generic extended mass distribution. For that, we consider the diffraction of electromagnetic (EM) waves by an extended, weakly aspherical, gravitating object. We account for the static gravitational field of such a lens by representing its exterior potential in the most generic form, expressed via an infinite set of symmetric trace free (STF) tensor multipole mass moments. This yields the most general form of the gravitational phase shift, which allows for a comprehensive description of the optical properties of a generic gravitational lens. We found that at each order of the STF moments, the gravitational phase shift is characterized by only two parameters: a magnitude and a rotation angle that characterize the corresponding caustics, which form in the point spread function (PSF) of the lens. Both of these parameters are uniquely expressed in terms of the transverse-trace free (TT) projections of the multipole moments on the lens plane. Not only does this result simplify the development of physically consistent models of realistic lenses, it also drastically reduces the number of required parameters in the ultimate model. To help with the interpretation of the results, we established the correspondence of the gravitational phase shift expressed via the TT-projected STF multipole mass moments and its representation via spherical harmonics. For axisymmetric mass distributions, the new results are consistent with those that we obtained in previous studies. For arbitrary mass distributions, our results are novel and offer new insight into gravitational lensing by realistic astrophysical systems. These findings are discussed in the context of ongoing astrophysical gravitational lensing investigations as well as observations that are planned with the solar gravitational lens (SGL).


title: Stability of the Volume Preserving Mean Curvature Flow in Hyperbolic Space

abstract: We consider the dynamic property of the volume preserving mean curvature flow. This flow was introduced by Huisken who also proved it converges to a round sphere of the same enclosed volume if the initial hypersurface is strictly convex in Euclidean space. We study the stability of this flow in hyperbolic space. In particular, we prove that if the initial hypersurface is hyperbolically mean convex and close to an umbilical sphere in the $L^2$-sense, then the flow exists for all time and converges exponentially to an umbilical sphere.


title: Towards an enabling environment for social accountability in Bangladesh

abstract: Social accountability refers to promoting good governance by making ruling elites more responsive. In Bangladesh, where bureaucracy and legislature operate with little effective accountability or checks and balances, traditional horizontal or vertical accountability proved to be very blunt and weak. In the presence of such faulty mechanisms, ordinary citizens access to information is frequently denied, and their voices are kept mute. It impasses the formation of an enabling environment, where activists and civil society institutions representing the ordinary peoples interest are actively discouraged. They become vulnerable to retribution. Social accountability, on the other hand, provides an enabling environment for activists and civil society institutions to operate freely. Thus, leaders and administration become more accountable to people. An enabling environment means providing legal protection, enhancing the availability of information and increasing citizen voice, strengthening institutional and public service capacities and directing incentives that foster accountability. Donors allocate significant shares of resources to encouraging civil society to partner with elites rather than holding them accountable. This paper advocate for a stronger legal environment to protect critical civil society and whistle-blowers, and for independent grant-makers tasked with building strong, self-regulating social accountability institutions. Key Words: Accountability, Legal Protection, Efficiency, Civil Society, Responsiveness


title: Freedom of mixer rotation-axis improves performance in the quantum approximate optimization algorithm

abstract: Variational quantum algorithms such as the quantum approximate optimization algorithm (QAOA) are particularly attractive candidates for implementation on near-term quantum processors. As hardware realities such as error and qubit connectivity will constrain achievable circuit depth in the near future, new ways to achieve high-performance at low depth are of great interest. In this work, we present a modification to QAOA that adds additional variational parameters in the form of freedom of the rotation-axis in the $XY$-plane of the mixer Hamiltonian. Via numerical simulation, we show that this leads to a drastic performance improvement over standard QAOA at finding solutions to the MAXCUT problem on graphs of up to 7 qubits. Furthermore, we explore the Z-phase error mitigation properties of our modified ansatz, its performance under a realistic error model for a neutral atom quantum processor, and the class of problems it can solve in a single round.


title: Comments on wormholes and factorization

abstract: In AdS/CFT partition functions of decoupled copies of the CFT factorize. In bulk computations of such quantities contributions from spacetime wormholes which link separate asymptotic boundaries threaten to spoil this property, leading to a "factorization puzzle." Certain simple models like JT gravity have wormholes, but bulk computations in them correspond to averages over an ensemble of boundary systems. These averages need not factorize. We can formulate a toy version of the factorization puzzle in such models by focusing on a specific member of the ensemble where partition functions will again factorize. As Coleman and Giddings-Strominger pointed out in the 1980s, fixed members of ensembles are described in the bulk by "$\alpha$-states" in a many-universe Hilbert space. In this paper we analyze in detail the bulk mechanism for factorization in such $\alpha$-states in the topological model introduced by Marolf and Maxfield (the "MM model") and in JT gravity. In these models geometric calculations in $\alpha$ states are poorly controlled. We circumvent this complication by working in $\textit{approximate}$ $\alpha$ states where bulk calculations just involve the simplest topologies: disks and cylinders. One of our main results is an effective description of the factorization mechanism. In this effective description the many-universe contributions from the full $\alpha$ state are replaced by a small number of effective boundaries. Our motivation in constructing this effective description, and more generally in studying these simple ensemble models, is that the lessons learned might have wider applicability. In fact the effective description lines up with a recent discussion of the SYK model with fixed couplings arXiv:2103.16754. We conclude with some discussion about the possible applicability of this effective model in more general contexts.


title: Ce-site dilution in the ferromagnetic Kondo lattice CeRh$_6$Ge$_4$

abstract: The heavy fermion ferromagnet CeRh$_6$Ge$_4$ is the first example of a clean stoichiometric system where the ferromagnetic transition can be continuously suppressed by hydrostatic pressure to a quantum critical point. In order to reveal the outcome when the magnetic lattice of CeRh$_6$Ge$_4$ is diluted with non-magnetic atoms, this study reports comprehensive measurements of the physical properties of both single crystal and polycrystalline samples of La$_x$Ce$_{1-x}$Rh$_6$Ge$_4$. With increasing $x$, the Curie temperature decreases, and no transition is observed for $x$ $>$ 0.25, while the system evolves from exhibiting coherent Kondo lattice behaviors at low $x$, to the Kondo impurity scenario at large $x$. Moreover, non-Fermi liquid behavior (NFL) is observed over a wide doping range, which agrees well with the disordered Kondo model for 0.52 $\leq$ $x$ $\leq$ 0.66, while strange metal behavior is revealed in the vicinity of $x_c$ = 0.26.


title: Unsupervised Learning of Neurosymbolic Encoders

abstract: We present a framework for the unsupervised learning of neurosymbolic encoders, which are encoders obtained by composing neural networks with symbolic programs from a domain-specific language. Our framework naturally incorporates symbolic expert knowledge into the learning process, which leads to more interpretable and factorized latent representations compared to fully neural encoders. We integrate modern program synthesis techniques with the variational autoencoding (VAE) framework, in order to learn a neurosymbolic encoder in conjunction with a standard decoder. The programmatic descriptions from our encoders can benefit many analysis workflows, such as in behavior modeling where interpreting agent actions and movements is important. We evaluate our method on learning latent representations for real-world trajectory data from animal biology and sports analytics. We show that our approach offers significantly better separation of meaningful categories than standard VAEs and leads to practical gains on downstream analysis tasks, such as for behavior classification.


title: Divergence equations and uniqueness theorem of static spacetimes with conformal scalar hair

abstract: We reexamine the Israel-type proof of the uniqueness theorem of the static spacetime outside the photon surface in the Einstein-conformal scalar system. We derive in a systematic fashion a new divergence identity which plays a key role in the proof. Our divergence identity includes three parameters, allowing us to give a new proof of the uniqueness.


title: Stirring Speeds Up Chemical Reaction

abstract: We consider absorbing chemical reactions in a fluid flow modeled by the coupled advection-reaction-diffusion equations. In these systems, the interplay between chemical diffusion and fluid transportation causes the enhanced dissipation phenomenon. We show that the enhanced dissipation time scale, together with the reaction coupling strength, determines the characteristic time scale of the reaction.


title: Overspinning problem in Kerr black holes: second order corrections and self-energy

abstract: We consider gedanken experiments to destroy Kerr black holes by means of absorbing matter with sufficient energy and angular momentum. It is shown that extremal and near-extremal Kerr black holes cannot be destroyed in a process that includes a second order contribution to its final mass, and matter sources satisfy the null energy condition. Such contribution is calculated using hypersurface integration on the event horizon, and it traces similarities with terms related to matter-black hole interactions and a rotational self-energy lower bound suggested in previous works.


title: Insights from Generative Modeling for Neural Video Compression

abstract: While recent machine learning research has revealed connections between deep generative models such as VAEs and rate-distortion losses used in learned compression, most of this work has focused on images. In a similar spirit, we view recently proposed neural video coding algorithms through the lens of deep autoregressive and latent variable modeling. We present these codecs as instances of a generalized stochastic temporal autoregressive transform, and propose new avenues for further improvements inspired by normalizing flows and structured priors. We propose several architectures that yield state-of-the-art video compression performance on high-resolution video and discuss their tradeoffs and ablations. In particular, we propose (i) improved temporal autoregressive transforms, (ii) improved entropy models with structured and temporal dependencies, and (iii) variable bitrate versions of our algorithms. Since our improvements are compatible with a large class of existing models, we provide further evidence that the generative modeling viewpoint can advance the neural video coding field.


title: Unsupervised Monocular Depth Estimation in Highly Complex Environments

abstract: With the development of computational intelligence algorithms, unsupervised monocular depth and pose estimation framework, which is driven by warped photometric consistency, has shown great performance in the daytime scenario. While in some challenging environments, like night and rainy night, the essential photometric consistency hypothesis is untenable because of the complex lighting and reflection, so that the above unsupervised framework cannot be directly applied to these complex scenarios. In this paper, we investigate the problem of unsupervised monocular depth estimation in highly complex scenarios and address this challenging problem by adopting an image transfer-based domain adaptation framework. We adapt the depth model trained on day-time scenarios to be applicable to night-time scenarios, and constraints on both feature space and output space promote the framework to learn the key features for depth decoding. Meanwhile, we further tackle the effects of unstable image transfer quality on domain adaptation, and an image adaptation approach is proposed to evaluate the quality of transferred images and re-weight the corresponding losses, so as to improve the performance of the adapted depth model. Extensive experiments show the effectiveness of the proposed unsupervised framework in estimating the dense depth map from highly complex images.


title: The Ground State Energy and Concentration of Complexity in Spherical Bipartite Models

abstract: We establish an asymptotic formula for the ground-state energy of the spherical pure $(p,q)$-spin glass model for $p,q\ge 97$. We achieve this through understanding the concentration of the complexity of critical points with values within a region of the ground state energy. More specifically, we show that the second moment of this count coincides with the square of the first moment up to a sub-exponential factor.


title: Sharp superlevel set estimates for small cap decouplings of the parabola

abstract: We prove sharp bounds for the size of superlevel sets $\{x\in \mathbb{R}^2:|f(x)|>\alpha\}$ where $\alpha>0$ and $f:\mathbb{R}^2\to\mathbb{C}$ is a Schwartz function with Fourier transform supported in an $R^{-1}$-neighborhood of the truncated parabola $\mathbb{P}^1$. These estimates imply the small cap decoupling theorem for $\mathbb{P}^1$ of Demeter, Guth, and Wang, and the canonical decoupling theorem for $\mathbb{P}^1$ of Bourgain and Demeter. New $(\ell^q,L^p)$ small cap decoupling inequalities also follow from our sharp level set estimates.


title: $\Lambda_c \to \Lambda^*(1520)$ form factors from lattice QCD and improved analysis of the $\Lambda_b \to \Lambda^*(1520)$ and $\Lambda_b \to \Lambda_c^*(2595,2625)$ form factors

abstract: We present the first lattice-QCD calculation of the form factors governing the charm-baryon semileptonic decays $\Lambda_c \to \Lambda^*(1520)\ell^+\nu_\ell$. As in our previous calculation of the $\Lambda_b \to \Lambda^*(1520)$ form factors, we work in the $\Lambda^*(1520)$ rest frame, but here we use four different heavy-baryon momenta instead of just two. Because of the lower mass of the $\Lambda_c$, the moderately-sized momenta used here are sufficient to determine the form factors in the full kinematic range of the semileptonic decay. We also update the analysis of our lattice results for the $\Lambda_b \to \Lambda^*(1520)$ and $\Lambda_b \to \Lambda_c^*(2595,2625)$ form factors by imposing exact relations among the different form factors at zero recoil that follow from rotational symmetry. Imposing these relations ensures the correct behavior of the angular observables near the endpoint.


title: The magnetic system SMSS J1606-1000 as a period bouncer

abstract: We report the discovery of a rare close binary system, SMSS J160639.78-100010.7, comprised of a magnetic white dwarf with a field of about 30 MG and a brown dwarf. We measured an orbital period of 92 min which is consistent with the photometric period. Minimum and maximum light occur at the orbital quadratures Phi=0.25 and 0.75, respectively, and cannot be caused by reflection on the brown dwarf, but, instead, by a spot on the synchronously rotating magnetic white dwarf. The brown dwarf does not fill its Roche lobe and the system may be in a low-accretion state or, more likely, in a detached state following episodes of mass transfer. SMSS J160639.78-100010.7 is the nearest known magnetic white dwarf plus brown dwarf system.


title: The origin of X-ray emission in 3CRR sources: hints from mid-infrared Spitzer observations

abstract: Whether X-ray emission in radio-loud (RL) active galactic nuclei (AGNs) originates from disk coronae or jets is still under debate. For example, the positive relationships in radio-quiet (RQ) AGNs (such as the optical to X-ray spectral index $\alpha_{\rm {OX}}$ and Eddington ration $\lambda_{\rm {O}}$ as well as the X-ray photon index $\Gamma$ and $\lambda_{\rm {O}}$) are not detected in RLAGNs. We intend to further investigate this issue in this work. A sample of 27 luminous sources (including 16 quasars and 11 high-excitation radio galaxies) was selected from the 3CRR catalog to reinvestigate the origin of X-ray emission in RLAGNs, where the X-ray and mid-infrared fluxes are observed by Chandra/XMM-Newton and Spitzer, respectively. It is found for the first time that there is a significant relationship between the mid-infrared to X-ray spectral index $\alpha_{\rm {IX}}$ and $\lambda_{\rm {IR}}$ for whole sample, while there is no relationship between $\alpha_{\rm {OX}}$ and $\lambda_{\rm {O}}$ in quasars. There are strong positive relationships between both $L_{\rm {R}}$-$L_{\rm {X}}$ and $L_{\rm {UV}}$-$L_{\rm {X}}$ panels, which can be well fitted by the disk-corona model. However, there is no significant relationship between $\Gamma$ and $\lambda_{\rm {IR}}$. The possible reason is related to the effects of the large-scale magnetic field in RLAGNs. We suggest that the X-ray emission in high-excitation RLAGNs originates from a disk-corona system.


title: CycleGAN-based Non-parallel Speech Enhancement with an Adaptive Attention-in-attention Mechanism

abstract: Non-parallel training is a difficult but essential task for DNN-based speech enhancement methods, for the lack of adequate noisy and paired clean speech corpus in many real scenarios. In this paper, we propose a novel adaptive attention-in-attention CycleGAN (AIA-CycleGAN) for non-parallel speech enhancement. In previous CycleGAN-based non-parallel speech enhancement methods, the limited mapping ability of the generator may cause performance degradation and insufficient feature learning. To alleviate this degradation, we propose an integration of adaptive time-frequency attention (ATFA) and adaptive hierarchical attention (AHA) to form an attention-in-attention (AIA) module for more flexible feature learning during the mapping procedure. More specifically, ATFA can capture the long-range temporal-spectral contextual information for more effective feature representations, while AHA can flexibly aggregate different AFTA's intermediate output feature maps by adaptive attention weights depending on the global context. Numerous experimental results demonstrate that the proposed approach achieves consistently more superior performance over previous GAN-based and CycleGAN-based methods in non-parallel training. Moreover, experiments in parallel training verify that the proposed AIA-CycleGAN also outperforms most advanced GAN-based and Non-GAN based speech enhancement approaches, especially in maintaining speech integrity and reducing speech distortion.


title: Content-aware Directed Propagation Network with Pixel Adaptive Kernel Attention

abstract: Convolutional neural networks (CNNs) have been not only widespread but also achieved noticeable results on numerous applications including image classification, restoration, and generation. Although the weight-sharing property of convolutions makes them widely adopted in various tasks, its content-agnostic characteristic can also be considered a major drawback. To solve this problem, in this paper, we propose a novel operation, called pixel adaptive kernel attention (PAKA). PAKA provides directivity to the filter weights by multiplying spatially varying attention from learnable features. The proposed method infers pixel-adaptive attention maps along the channel and spatial directions separately to address the decomposed model with fewer parameters. Our method is trainable in an end-to-end manner and applicable to any CNN-based models. In addition, we propose an improved information aggregation module with PAKA, called the hierarchical PAKA module (HPM). We demonstrate the superiority of our HPM by presenting state-of-the-art performance on semantic segmentation compared to the conventional information aggregation modules. We validate the proposed method through additional ablation studies and visualizing the effect of PAKA providing directivity to the weights of convolutions. We also show the generalizability of the proposed method by applying it to multi-modal tasks especially color-guided depth map super-resolution.


title: Narrow-gap semiconducting behavior in antiferromagnetic Eu$_{11}$InSb$_9$

abstract: Here we investigate the thermodynamic and electronic properties of Eu$_{11}$InSb$_9$ single crystals. Electrical transport data show that Eu$_{11}$InSb$_9$ has a semiconducting ground state with a relatively narrow band gap of $320$~meV. Magnetic susceptibility data reveal antiferromagnetic order at low temperatures, whereas ferromagnetic interactions dominate at high temperature. Specific heat, magnetic susceptibility, and electrical resistivity measurements reveal three phase transitions at $T_{N1}=9.3$~K, $T_{N2} =8.3$~K, and $T_{N3} =4.3$~K. Unlike Eu$_{5}$In$_{2}$Sb$_6$, a related europium-containing Zintl compound, no colossal magnetoresistance (CMR) is observed in Eu$_{11}$InSb$_9$. We attribute the absence of CMR to the smaller carrier density and the larger distance between Eu ions and In-Sb polyhedra in Eu$_{11}$InSb$_9$. Our results indicate that Eu$_{11}$InSb$_9$ has potential applications as a thermoelectric material through doping or as a long-wavelength detector due to its narrow gap.


title: Dynamic Programming and Linear Programming for Odds Problem

abstract: This paper discusses the odds problem, proposed by Bruss in 2000, and its variants. A recurrence relation called a dynamic programming (DP) equation is used to find an optimal stopping policy of the odds problem and its variants. In 2013, Buchbinder, Jain, and Singh proposed a linear programming (LP) formulation for finding an optimal stopping policy of the classical secretary problem, which is a special case of the odds problem. The proposed linear programming problem, which maximizes the probability of a win, differs from the DP equations known for long time periods. This paper shows that an ordinary DP equation is a modification of the dual problem of linear programming including the LP formulation proposed by Buchbinder, Jain, and Singh.


title: Mechanical Cloak via Data-Driven Aperiodic Metamaterial Design

abstract: Mechanical cloaks are materials engineered to manipulate the elastic response around objects to make them indistinguishable from their homogeneous surroundings. Typically, methods based on material-parameter transformations are used to design optical, thermal and electric cloaks. However, they are not applicable in designing mechanical cloaks, since continuum-mechanics equations are not form-invariant under general coordinate transformations. As a result, existing design methods for mechanical cloaks have so far been limited to a narrow selection of voids with simple shapes. To address this challenge, we present a systematic, data-driven design approach to create mechanical cloaks composed of aperiodic metamaterials using a large pre-computed unit cell database. Our method is flexible to allow the design of cloaks with various boundary conditions, multiple loadings, different shapes and numbers of voids, and different homogeneous surroundings. It enables a concurrent optimization of both topology and properties distribution of the cloak. Compared to conventional fixed-shape solutions, this results in an overall better cloaking performance, and offers unparalleled versatility. Experimental measurements on 3D-printed structures further confirm the validity of the proposed approach. Our research illustrates the benefits of data-driven approaches in quickly responding to new design scenarios and resolving the computational challenge associated with multiscale designs of functional structures. It could be generalized to accommodate other applications that require heterogeneous property distribution, such as soft robots and implants design.


title: Combining Machine Learning Classifiers for Stock Trading with Effective Feature Extraction

abstract: The unpredictability and volatility of the stock market render it challenging to make a substantial profit using any generalised scheme. Many previous studies tried different techniques to build a machine learning model, which can make a significant profit in the US stock market by performing live trading. However, very few studies have focused on the importance of finding the best features for a particular trading period. Our top approach used the performance to narrow down the features from a total of 148 to about 30. Furthermore, the top 25 features were dynamically selected before each time training our machine learning model. It uses ensemble learning with four classifiers: Gaussian Naive Bayes, Decision Tree, Logistic Regression with L1 regularization, and Stochastic Gradient Descent, to decide whether to go long or short on a particular stock. Our best model performed daily trade between July 2011 and January 2019, generating 54.35% profit. Finally, our work showcased that mixtures of weighted classifiers perform better than any individual predictor of making trading decisions in the stock market.


title: A machine learning approach to predict L-edge x-ray absorption spectra of light transition metal ion compounds

abstract: Simulation of spectra of x-ray absorption spectroscopy (XAS) at the L-edge is a well-established and reliable computational tool that, in combination with experimental measurements, reveals details about the local electronic structure and the chemical environment of transition metal ions (TMI). For light TMIs, model 2p XAS model Hamiltonian approaches (MHA) are fast and accurate in computing spectra. Here, an alternative method using artificial neural networks (ANN) is employed. The new approach predicts x-ray absorption spectra at the L-edge of light transition metals ions for elements from Ti to Ni, including different oxidation states, from sets of physical input parameters. Computational performance and accuracy were optimized through a systematic exploration of ANN design and compared to MHA simulations. While the MHA remains more accurate due to the statistical nature of the developed machine learning method, the ANN-based prediction of 2p XAS spectra achieved good accuracy of more than 99%, in addition to a noticeable advantage in computational speed. This makes the method intrinsically more suitable for computational high-throughput setups as well as in support of data-intense experimental workflows. However, the extrapolation weakness of artificial neural networks remained for most cases and displayed a strong dependence on the TMI. For one TMI, an extrapolation accuracy of 78% was maintained.


title: Zeptosecond dynamics in atoms: fact or fiction?

abstract: Photon exchange due to nuclear bremsstrahlung during nuclear collisions can cause Coulomb excitation in the projectile and the target nuclei. The corresponding process originated in nuclear timescales can also be observed in atomic phenomenon experimentally if it delayed by at least with an attosecond or longer timescales. We have found that this happens due to a mechanism involving the Eisenbud-Wigner-Smith time delay process. We have estimated photoionization time delays in atomic collisions utilizing the nonrelativistic version of random phase approximation with exchange and Hartree-Fock methods. We present three representative processes in which we can observe the phenomena in attosecond timescales even though they originate from excitations in the zeptosecond timescales. Thus the work represents an investigation of parallels between two neighboring areas of physics. Furthermore the present work suggests new possibilities for atomic physics research near the Coulomb barrier energy, where the laser is replaced by nuclear bremsstrahlung.


title: JPEG Steganography with Embedding Cost Learning and Side-Information Estimation

abstract: A great challenge to steganography has arisen with the wide application of steganalysis methods based on convolutional neural networks (CNNs). To this end, embedding cost learning frameworks based on generative adversarial networks (GANs) have been proposed and achieved success for spatial steganography. However, the application of GAN to JPEG steganography is still in the prototype stage; its anti-detectability and training efficiency should be improved. In conventional steganography, research has shown that the side-information calculated from the precover can be used to enhance security. However, it is hard to calculate the side-information without the spatial domain image. In this work, an embedding cost learning framework for JPEG Steganography via a Generative Adversarial Network (JS-GAN) has been proposed, the learned embedding cost can be further adjusted asymmetrically according to the estimated side-information. Experimental results have demonstrated that the proposed method can automatically learn a content-adaptive embedding cost function, and use the estimated side-information properly can effectively improve the security performance. For example, under the attack of a classic steganalyzer GFR with quality factor 75 and 0.4 bpnzAC, the proposed JS-GAN can increase the detection error 2.58% over J-UNIWARD, and the estimated side-information aided version JS-GAN(ESI) can further increase the security performance by 11.25% over JS-GAN.


title: Multi Point-Voxel Convolution (MPVConv) for Deep Learning on Point Clouds

abstract: The existing 3D deep learning methods adopt either individual point-based features or local-neighboring voxel-based features, and demonstrate great potential for processing 3D data. However, the point based models are inefficient due to the unordered nature of point clouds and the voxel-based models suffer from large information loss. Motivated by the success of recent point-voxel representation, such as PVCNN, we propose a new convolutional neural network, called Multi Point-Voxel Convolution (MPVConv), for deep learning on point clouds. Integrating both the advantages of voxel and point-based methods, MPVConv can effectively increase the neighboring collection between point-based features and also promote independence among voxel-based features. Moreover, most of the existing approaches aim at solving one specific task, and only a few of them can handle a variety of tasks. Simply replacing the corresponding convolution module with MPVConv, we show that MPVConv can fit in different backbones to solve a wide range of 3D tasks. Extensive experiments on benchmark datasets such as ShapeNet Part, S3DIS and KITTI for various tasks show that MPVConv improves the accuracy of the backbone (PointNet) by up to \textbf{36\%}, and achieves higher accuracy than the voxel-based model with up to \textbf{34}$\times$ speedups. In addition, MPVConv outperforms the state-of-the-art point-based models with up to \textbf{8}$\times$ speedups. Notably, our MPVConv achieves better accuracy than the newest point-voxel-based model PVCNN (a model more efficient than PointNet) with lower latency.


abstract: Neural Architecture Search (NAS) can automatically design well-performed architectures of Deep Neural Networks (DNNs) for the tasks at hand. However, one bottleneck of NAS is the prohibitively computational cost largely due to the expensive performance evaluation. The neural predictors can directly estimate the performance without any training of the DNNs to be evaluated, thus have drawn increasing attention from researchers. Despite their popularity, they also suffer a severe limitation: the shortage of annotated DNN architectures for effectively training the neural predictors. In this paper, we proposed Homogeneous Architecture Augmentation for Neural Predictor (HAAP) of DNN architectures to address the issue aforementioned. Specifically, a homogeneous architecture augmentation algorithm is proposed in HAAP to generate sufficient training data taking the use of homogeneous representation. Furthermore, the one-hot encoding strategy is introduced into HAAP to make the representation of DNN architectures more effective. The experiments have been conducted on both NAS-Benchmark-101 and NAS-Bench-201 dataset. The experimental results demonstrate that the proposed HAAP algorithm outperforms the state of the arts compared, yet with much less training data. In addition, the ablation studies on both benchmark datasets have also shown the universality of the homogeneous architecture augmentation.


title: Global Aggregation then Local Distribution for Scene Parsing

abstract: Modelling long-range contextual relationships is critical for pixel-wise prediction tasks such as semantic segmentation. However, convolutional neural networks (CNNs) are inherently limited to model such dependencies due to the naive structure in its building modules (\eg, local convolution kernel). While recent global aggregation methods are beneficial for long-range structure information modelling, they would oversmooth and bring noise to the regions containing fine details (\eg,~boundaries and small objects), which are very much cared for the semantic segmentation task. To alleviate this problem, we propose to explore the local context for making the aggregated long-range relationship being distributed more accurately in local regions. In particular, we design a novel local distribution module which models the affinity map between global and local relationship for each pixel adaptively. Integrating existing global aggregation modules, we show that our approach can be modularized as an end-to-end trainable block and easily plugged into existing semantic segmentation networks, giving rise to the \emph{GALD} networks. Despite its simplicity and versatility, our approach allows us to build new state of the art on major semantic segmentation benchmarks including Cityscapes, ADE20K, Pascal Context, Camvid and COCO-stuff. Code and trained models are released at \url{https://github.com/lxtGH/GALD-DGCNet} to foster further research.


title: Improving Video Instance Segmentation via Temporal Pyramid Routing

abstract: Video Instance Segmentation (VIS) is a new and inherently multi-task problem, which aims to detect, segment, and track each instance in a video sequence. Existing approaches are mainly based on single-frame features or single-scale features of multiple frames, where either temporal information or multi-scale information is ignored. To incorporate both temporal and scale information, we propose a Temporal Pyramid Routing (TPR) strategy to conditionally align and conduct pixel-level aggregation from a feature pyramid pair of two adjacent frames. Specifically, TPR contains two novel components, including Dynamic Aligned Cell Routing (DACR) and Cross Pyramid Routing (CPR), where DACR is designed for aligning and gating pyramid features across temporal dimension, while CPR transfers temporally aggregated features across scale dimension. Moreover, our approach is a light-weight and plug-and-play module and can be easily applied to existing instance segmentation methods. Extensive experiments on three datasets including YouTube-VIS (2019, 2021) and Cityscapes-VPS demonstrate the effectiveness and efficiency of the proposed approach on several state-of-the-art video instance and panoptic segmentation methods. Codes will be publicly available at \url{https://github.com/lxtGH/TemporalPyramidRouting}.


title: Shape Controllable Virtual Try-on for Underwear Models

abstract: Image virtual try-on task has abundant applications and has become a hot research topic recently. Existing 2D image-based virtual try-on methods aim to transfer a target clothing image onto a reference person, which has two main disadvantages: cannot control the size and length precisely; unable to accurately estimate the user's figure in the case of users wearing thick clothes, resulting in inaccurate dressing effect. In this paper, we put forward an akin task that aims to dress clothing for underwear models. %, which is also an urgent need in e-commerce scenarios. To solve the above drawbacks, we propose a Shape Controllable Virtual Try-On Network (SC-VTON), where a graph attention network integrates the information of model and clothing to generate the warped clothing image. In addition, the control points are incorporated into SC-VTON for the desired clothing shape. Furthermore, by adding a Splitting Network and a Synthesis Network, we can use clothing/model pair data to help optimize the deformation module and generalize the task to the typical virtual try-on task. Extensive experiments show that the proposed method can achieve accurate shape control. Meanwhile, compared with other methods, our method can generate high-resolution results with detailed textures.


title: Retinal Microvasculature as Biomarker for Diabetes and Cardiovascular Diseases

abstract: Purpose: To demonstrate that retinal microvasculature per se is a reliable biomarker for Diabetic Retinopathy (DR) and, by extension, cardiovascular diseases. Methods: Deep Learning Convolutional Neural Networks (CNN) applied to color fundus images for semantic segmentation of the blood vessels and severity classification on both vascular and full images. Vessel reconstruction through harmonic descriptors is also used as a smoothing and de-noising tool. The mathematical background of the theory is also outlined. Results: For diabetic patients, at least 93.8% of DR No-Refer vs. Refer classification can be related to vasculature defects. As for the Non-Sight Threatening vs. Sight Threatening case, the ratio is as high as 96.7%. Conclusion: In the case of DR, most of the disease biomarkers are related topologically to the vasculature. Translational Relevance: Experiments conducted on eye blood vasculature reconstruction as a biomarker shows a strong correlation between vasculature shape and later stages of DR.


title: Determination of compact Lie groups with the Borsuk-Ulam property

abstract: In this paper, we shall discuss the classical question of which compact Lie groups have the Borsuk-Ulam property and in particular we shall show that every extension group of a n-torus by a cyclic group of prime order does not have the Borsuk-Ulam property. This leads us that the only compact Lie groups with the Borsuk-Ulam property are an elementary abelian p-group and an n-torus, which is a final answer to the question.


title: Lattice QCD study of the elastic and transition form factors of charmed baryons

abstract: I review the progress made in calculating the elastic and transition form factors of charmed baryons from lattice simulations.


title: On the initial value problem for a class of nonlinear biharmonic equation with time-fractional derivative

abstract: In this work, we investigate the IVP for a time-fractional fourth-order equation with nonlinear source terms. More specifically, we consider the time-fractional biharmonic with exponential nonlinearity and the time-fractional Cahn-Hilliard equation. By using the Fourier transform concept, the generalized formula for the mild solution as well as the smoothing effects of resolvent operators are proved. For the IVP associated with the first one, by using the Orlicz space with the function $ \Xi(z)=e^{|z|^p}-1$ and some embeddings between it and the usual Lebesgue spaces, we prove that the solution is a global-in-time solution or it shall blow up in a finite time if the initial value is regular. In the case of singular initial data, the local-in-time/global-in-time existence and uniqueness are derived. Also, the regularity of the mild solution is investigated. For the IVP associated with the second one, some modifications to the generalized formula are made to deal with the nonlinear term. We also establish some important estimates for the derivatives of resolvent operators, they are the basis for using the Picard sequence to prove the local-in-time existence of the solution.


title: Gaussian quantum metrology in a dissipative environment

abstract: Quantum metrology pursues high-precision measurements of physical quantities by using quantum resources. However, the decoherence generally hinders its performance. Previous work found that the metrological error tends to diverge in the long-encoding-time regime due to the Born-Markovian approximate decoherence, which is called the no-go theorem of noisy quantum metrology. Here we propose a Gaussian quantum metrology scheme using bimodal quantized optical fields as the quantum probe. It achieves the precision of a sub-Heisenberg limit in the ideal case. However, the Markovian decoherence causes the metrological error contributed by the center-of-mass mode of the probe to be divergent. A mechanism to remove this ostensible no-go theorem is found in the non-Markovian dynamics. Our result gives an efficient way to realize high-precision quantum metrology in practical continuous-variable systems.


title: Multidimensional Lambert-Euler inversion and vector-multiplicative coalescent processes

abstract: In this paper we show the existence of the minimal solution to the multidimensional Lambert-Euler inversion, a multidimensional generalization of $[-e^{-1} ,0)$ branch of Lambert W function $W_0(x)$. Specifically, for a given nonnegative irreducible symmetric matrix $V \in \mathbb{R}^{k \times k}$, we show that for ${\bf u}\in(0,\infty)^k$, if equation $$y_j \exp\{-{\bf e}_j^T V {\bf y} \} = u_j ~~~~~~\forall j=1,...,k,$$ has at least one solution, it must have a minimal solution ${\bf y}^*$, where the minimum is achieved in all coordinates $y_j$ simultaneously. Moreover, such ${\bf y}^*$ is the unique solution satisfying $\rho\left(V D[y^*_j] \right) \leq 1$, where $D[y^*_j]={\sf diag}(y_j^*)$ is the diagonal matrix with entries $y^*_j$ and $\rho$ denotes the spectral radius. Our main application is in the vector-multiplicative coalescent process. It is a coalescent process with $k$ types of particles and vector-valued weights that begins with $\alpha_1n+...+\alpha_k n$ particles partitioned into types of respective sizes, and in which two clusters of weights ${\bf x}$ and ${\bf y}$ would merge with rate $({\bf x}^{\sf T} V {\bf y})/n$. We use combinatorics to solve the corresponding modified Smoluchowski equations, obtained as a hydrodynamic limit of vector-multiplicative coalescent as $n \to \infty$, and use multidimensional Lambert-Euler inversion to establish gelation and find a closed form expression for the gelation time. We also find the asymptotic length of the minimal spanning tree for a broad range of graphs equipped with random edge lengths.


title: Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers

abstract: A common lens to theoretically study neural net architectures is to analyze the functions they can approximate. However, constructions from approximation theory may be unrealistic and therefore less meaningful. For example, a common unrealistic trick is to encode target function values using infinite precision. To address these issues, this work proposes a formal definition of statistically meaningful (SM) approximation which requires the approximating network to exhibit good statistical learnability. We study SM approximation for two function classes: boolean circuits and Turing machines. We show that overparameterized feedforward neural nets can SM approximate boolean circuits with sample complexity depending only polynomially on the circuit size, not the size of the network. In addition, we show that transformers can SM approximate Turing machines with computation time bounded by $T$ with sample complexity polynomial in the alphabet size, state space size, and $\log (T)$. We also introduce new tools for analyzing generalization which provide much tighter sample complexities than the typical VC-dimension or norm-based bounds, which may be of independent interest.


title: Transferring Fourier Multipliers from Rn to Compact Lie Groups

abstract: This paper uses the wrapping map of Dooley and Wildberger to prove Lp boundedness of multipliers on compact Lie groups by transferring the estimate from Rn. This improves the bounds in several cases, and simplifies the proofs of others.


title: Towards Emotion-Aware Agents For Negotiation Dialogues

abstract: Negotiation is a complex social interaction that encapsulates emotional encounters in human decision-making. Virtual agents that can negotiate with humans are useful in pedagogy and conversational AI. To advance the development of such agents, we explore the prediction of two important subjective goals in a negotiation - outcome satisfaction and partner perception. Specifically, we analyze the extent to which emotion attributes extracted from the negotiation help in the prediction, above and beyond the individual difference variables. We focus on a recent dataset in chat-based negotiations, grounded in a realistic camping scenario. We study three degrees of emotion dimensions - emoticons, lexical, and contextual by leveraging affective lexicons and a state-of-the-art deep learning architecture. Our insights will be helpful in designing adaptive negotiation agents that interact through realistic communication interfaces.


title: Performance Analysis of Dual-Hop THz Transmission Systems over $\alpha$-$\mu$ Fading Channels with Pointing Errors

abstract: In this paper, the performance of a dual-hop relaying terahertz (THz) wireless communication system is investigated. In particular, the behaviors of the two THz hops are determined by three factors, which are the deterministic path loss, the fading effects, and pointing errors. Assuming that both THz links are subject to the $\alpha$-$\mu$ fading with pointing errors, we derive exact expressions for the cumulative distribution function (CDF) and probability density function (PDF) of the end-to-end signal-to-noise ratio (SNR). Relying on the CDF and PDF, important performance metrics are evaluated, such as the outage probability, average bit error rate, and average channel capacity. Moreover, the asymptotic analyses are presented to obtain more insights. Results show that the dual-hop relaying scheme has better performance than the single THz link. The system's diversity order is $\min\left\{\frac{\phi_1}{2},\frac{\alpha_1\mu_1}{2},\phi_2,\alpha_2\mu_2\right\}$, where $\alpha_i$ and $\mu_i$ represent the fading parameters of the $i$-th THz link for $i\in(1,2)$, and $\phi_i$ denotes the pointing error parameter. In addition, we extend the analysis to a multi-relay cooperative system and derive the asymptotic symbol error rate expressions. Results demonstrate that the diversity order of the multi-relay system is $K\min\left\{\frac{\phi_1}{2},\frac{\alpha_1\mu_1}{2},\phi_2,\alpha_2\mu_2\right\}$, where $K$ is the number of relays. Finally, the derived analytical expressions are verified by Monte Carlo simulation.


title: Unsupervised Segmentation for Terracotta Warrior with Seed-Region-Growing CNN (SRG-Net)

abstract: The repairing work of terracotta warriors in Emperor Qinshihuang Mausoleum Site Museum is handcrafted by experts, and the increasing amounts of unearthed pieces of terracotta warriors make the archaeologists too challenging to conduct the restoration of terracotta warriors efficiently. We hope to segment the 3D point cloud data of the terracotta warriors automatically and store the fragment data in the database to assist the archaeologists in matching the actual fragments with the ones in the database, which could result in higher repairing efficiency of terracotta warriors. Moreover, the existing 3D neural network research is mainly focusing on supervised classification, clustering, unsupervised representation, and reconstruction. There are few pieces of researches concentrating on unsupervised point cloud part segmentation. In this paper, we present SRG-Net for 3D point clouds of terracotta warriors to address these problems. Firstly, we adopt a customized seed-region-growing algorithm to segment the point cloud coarsely. Then we present a supervised segmentation and unsupervised reconstruction networks to learn the characteristics of 3D point clouds. Finally, we combine the SRG algorithm with our improved CNN using a refinement method. This pipeline is called SRG-Net, which aims at conducting segmentation tasks on the terracotta warriors. Our proposed SRG-Net is evaluated on the terracotta warriors data and ShapeNet dataset by measuring the accuracy and the latency. The experimental results show that our SRG-Net outperforms the state-of-the-art methods. Our code is shown in Code File 1~\cite{Srgnet_2021}.


title: Mock catalogues of emission line galaxies based on the local mass density in dark-matter only simulations

abstract: The high-precision measurement of spatial clustering of emission line galaxies (ELGs) is a primary objective for upcoming cosmological spectroscopic surveys. The source of strong emission of ELGs is nebular emission from surrounding ionized gas irradiated by massive short-lived stars in star-forming galaxies. As a result, ELGs are more likely to reside in newly-formed halos and this leads to a nonlinear relation between ELG number density and matter density fields. In order to estimate the covariance matrix of cosmological observables, it is essential to produce many independent realisations to simulate ELG distributions for large survey volumes. To this end, we present a novel and fast scheme to populate ELGs in dark-matter only $N$-body simulations based on local density field. This method enables fast production of mock ELG catalogues suitable for verifying analysis methods and quantifying observational systematics in upcoming spectroscopic surveys and can populate ELGs in moderately high-density regions even though the halo structure cannot be resolved due to low resolution. The power spectrum of simulated ELGs is consistent with results of hydrodynamical simulations up to fairly small scales ($\lesssim 1 h \, \mathrm{Mpc}^{-1}$), and the simulated ELGs are more likely to be found in filamentary structures, which is consistent with results of semi-analytic and hydrodynamical simulations. Furthermore, we address the redshift-space power spectrum of simulated ELGs. The measured multipole moments of simulated ELGs clearly exhibit a weaker Finger-of-God effect than those of matter due to infalling motions towards halo centre, rather than random virial motions inside halos.


title: Rogue and solitary waves in coupled phononic crystals

abstract: In this work we present an analytical and numerical study of rogue and solitary waves in a coupled one-dimensional nonlinear lattice that involves both axial and rotational degrees of freedom. Using a multiple-scale analysis we derive a system of coupled nonlinear Schr\"odinger type equations in order to approximate solitary waves and rogue waves of the coupled lattice model. Numerical simulations are found to agree with the analytical approximations. We also consider generic initialization data in the form of a Gaussian profile and observe that they can result in the spontaneous formation of rogue wave-like patterns in the lattice. The solitary and rogue waves in the lattice demonstrate both energy isolation and exchange between the axial and rotational degrees of freedom of the system. This suggests that the studied coupled lattice has the potential to be an efficient energy isolation, transfer, and focusing medium.


title: Accurate Grid Keypoint Learning for Efficient Video Prediction

abstract: Video prediction methods generally consume substantial computing resources in training and deployment, among which keypoint-based approaches show promising improvement in efficiency by simplifying dense image prediction to light keypoint prediction. However, keypoint locations are often modeled only as continuous coordinates, so noise from semantically insignificant deviations in videos easily disrupt learning stability, leading to inaccurate keypoint modeling. In this paper, we design a new grid keypoint learning framework, aiming at a robust and explainable intermediate keypoint representation for long-term efficient video prediction. We have two major technical contributions. First, we detect keypoints by jumping among candidate locations in our raised grid space and formulate a condensation loss to encourage meaningful keypoints with strong representative capability. Second, we introduce a 2D binary map to represent the detected grid keypoints and then suggest propagating keypoint locations with stochasticity by selecting entries in the discrete grid space, thus preserving the spatial structure of keypoints in the longterm horizon for better future frame generation. Extensive experiments verify that our method outperforms the state-ofthe-art stochastic video prediction methods while saves more than 98% of computing resources. We also demonstrate our method on a robotic-assisted surgery dataset with promising results. Our code is available at https://github.com/xjgaocs/Grid-Keypoint-Learning.


title: Learning with Multiclass AUC: Theory and Algorithms

abstract: The Area under the ROC curve (AUC) is a well-known ranking metric for problems such as imbalanced learning and recommender systems. The vast majority of existing AUC-optimization-based machine learning methods only focus on binary-class cases, while leaving the multiclass cases unconsidered. In this paper, we start an early trial to consider the problem of learning multiclass scoring functions via optimizing multiclass AUC metrics. Our foundation is based on the M metric, which is a well-known multiclass extension of AUC. We first pay a revisit to this metric, showing that it could eliminate the imbalance issue from the minority class pairs. Motivated by this, we propose an empirical surrogate risk minimization framework to approximately optimize the M metric. Theoretically, we show that: (i) optimizing most of the popular differentiable surrogate losses suffices to reach the Bayes optimal scoring function asymptotically; (ii) the training framework enjoys an imbalance-aware generalization error bound, which pays more attention to the bottleneck samples of minority classes compared with the traditional $O(\sqrt{1/N})$ result. Practically, to deal with the low scalability of the computational operations, we propose acceleration methods for three popular surrogate loss functions, including the exponential loss, squared loss, and hinge loss, to speed up loss and gradient evaluations. Finally, experimental results on 11 real-world datasets demonstrate the effectiveness of our proposed framework.


title: Combined detection of supernova neutrino signals

abstract: Supernova neutrino detection in neutrino and dark matter experiments is usually implemented as a real-time trigger system based on counting neutrino interactions within a moving time window. The sensitivity reach of such experiments can be improved by taking into account the time profile of the expected signal. We propose a shape analysis of the incoming experimental data based on a log likelihood ratio variable containing the assumed signal shape. This approach also allows a combination of potential supernova signals in different detectors for a further sensitivity boost. The method is tested on the NOvA detectors to study their combined sensitivity to the core-collapse supernova signal, and also on KamLAND, Borexino and SK-Gd as potential detectors of presupernova neutrinos. Using the shape analysis enhances the signal significance for supernova detection and prediction, as well as the sensitivity reach of the experiment. It also extends the supernova prediction time when applied to the presupernova neutrino signal detection. Enhancements achieved with the shape analysis persist even in the case when the actual signal doesn't match the expected signal model.


title: New Metrics to Evaluate the Performance and Fairness of Personalized Federated Learning

abstract: In Federated Learning (FL), the clients learn a single global model (FedAvg) through a central aggregator. In this setting, the non-IID distribution of the data across clients restricts the global FL model from delivering good performance on the local data of each client. Personalized FL aims to address this problem by finding a personalized model for each client. Recent works widely report the average personalized model accuracy on a particular data split of a dataset to evaluate the effectiveness of their methods. However, considering the multitude of personalization approaches proposed, it is critical to study the per-user personalized accuracy and the accuracy improvements among users with an equitable notion of fairness. To address these issues, we present a set of performance and fairness metrics intending to assess the quality of personalized FL methods. We apply these metrics to four recently proposed personalized FL methods, PersFL, FedPer, pFedMe, and Per-FedAvg, on three different data splits of the CIFAR-10 dataset. Our evaluations show that the personalized model with the highest average accuracy across users may not necessarily be the fairest. Our code is available at https://tinyurl.com/1hp9ywfa for public use.


title: Hiding in Temporal Networks

abstract: Social network analysis tools can infer various attributes just by scrutinizing one's connections. Several researchers have studied the problem faced by an evader whose goal is to strategically rewire their social connections in order to mislead such tools, thereby concealing their private attributes. However, to date, this literature has only considered static networks, while neglecting the more general case of temporal networks, where the structure evolves over time. Driven by this observation, we study how the evader can conceal their importance from an adversary armed with temporal centrality measures. We consider computational and structural aspects of this problem: Is it computationally feasible to calculate optimal ways of hiding? If it is, what network characteristics facilitate hiding? This topic has been studied in static networks, but in this work, we add realism to the problem by considering temporal networks of edges changing in time. We find that it is usually computationally infeasible to find the optimal way of hiding. On the other hand, by manipulating one's contacts, one could add a surprising amount of privacy. Compared to static networks, temporal networks offer more strategies for this type of manipulation and are thus, to some extent, easier to hide in.


title: Ultrastrong tunable coupler between superconducting LC resonators

abstract: We investigate the ultrastrong tunable coupler for coupling of superconducting resonators. Obtained coupling constant exceeds 1 GHz, and the wide range tunability is achieved both antiferromagnetics and ferromagnetics from $-1086$ MHz to 604 MHz. The ultrastrong coupler is composed of rf-SQUID and dc-SQUID as tunable junctions, which connected to resonators via shared aluminum thin film meander lines enabling such a huge coupling constant. The spectrum of the coupler obviously shows the breaking of the rotating wave approximation, and our circuit model treating the Josephson junction as a tunable inductance reproduces the experimental results well. The ultrastrong coupler is expected to be utilized in quantum annealing circuits and/or NISQ devices with dense connections between qubits.


title: Boosted Self-Interacting Dark Matter and XENON1T Excess

abstract: We present a self-interacting boosted dark matter (DM) scenario as a possible explanation of the recently reported excess of electron recoil events by the XENON1T experiment. The Standard Model (SM) has been extended with two vector-like fermion singlets charged under a dark $U(1)_D$ gauge symmetry to describe the dark sector. While the presence of light vector boson mediator leads to sufficient DM self-interactions to address the small scale issues of cold dark matter, the model with sub-GeV scale DM can explain the XENON1T excess via elastic scattering of boosted DM component with electrons at the detector. Strong annihilation of DM into the light mediator leads to a suppressed thermal relic. A hybrid setup of dark freeze-out and non-thermal contribution from the late decay of a scalar can lead to correct relic abundance. We fit our model with XENON1T data and also find the final parameter space consistent with self-interaction of DM, DM-electron scattering rate, as well as astrophysical and cosmological observations. A tiny parameter space consistent with all these constraints and requirements can be further scrutinized in near-future experiments.


title: Label Design-based ELM Network for Timing Synchronization in OFDM Systems with Nonlinear Distortion

abstract: Due to the nonlinear distortion in Orthogonal frequency division multiplexing (OFDM) systems, the timing synchronization (TS) performance is inevitably degraded at the receiver. To relieve this issue, an extreme learning machine (ELM)-based network with a novel learning label is proposed to the TS of OFDM system in our work and increases the possibility of symbol timing offset (STO) estimation residing in inter-symbol interference (ISI)-free region. Especially, by exploiting the prior information of the ISI-free region, two types of learning labels are developed to facilitate the ELM-based TS network. With designed learning labels, a timing-processing by classic TS scheme is first executed to capture the coarse timing metric (TM) and then followed by an ELM network to refine the TM. According to experiments and analysis, our scheme shows its effectiveness in the improvement of TS performance and reveals its generalization performance in different training and testing channel scenarios.


title: Puff turbulence in the limit of strong buoyancy

abstract: We provide a numerical validation of a recently proposed phenomenological theory to characterize the space-time statistical properties of a turbulent puff, both in terms of bulk properties, such as the mean velocity, temperature and size, and scaling laws for velocity and temperature differences both in the viscous and in the inertial range of scales. In particular, apart from the more classical shear-dominated puff turbulence, our main focus is on the recently discovered new regime where turbulent fluctuations are dominated by buoyancy. The theory is based on an adiabaticity hypothesis which assumes that small-scale turbulent fluctuations rapidly relax to the slower large-scale dynamics, leading to a generalization of the classical Kolmogorov and Kolmogorov-Obukhov-Corrsin theories for a turbulent puff hosting a scalar field. We validate our theory by means of massive direct numerical simulations finding excellent agreement.


title: Conflict Detection in IoT-based Smart Homes

abstract: We propose a novel framework that detects conflicts in IoT-based smart homes. Conflicts may arise during interactions between the resident and IoT services in smart homes. We propose a generic knowledge graph to represent the relations between IoT services and environment entities. We also profile a generic knowledge graph to a specific smart home setting based on the context information. We propose a conflict taxonomy to capture different types of conflicts in a single resident smart home setting. A conflict detection algorithm is proposed to identify potential conflicts using the profiled knowledge graph. We conduct a set of experiments on real datasets and synthesized datasets to validate the effectiveness and efficiency of our proposed approach.


title: Squeeze-Excitation Convolutional Recurrent Neural Networks for Audio-Visual Scene Classification

abstract: The use of multiple and semantically correlated sources can provide complementary information to each other that may not be evident when working with individual modalities on their own. In this context, multi-modal models can help producing more accurate and robust predictions in machine learning tasks where audio-visual data is available. This paper presents a multi-modal model for automatic scene classification that exploits simultaneously auditory and visual information. The proposed approach makes use of two separate networks which are respectively trained in isolation on audio and visual data, so that each network specializes in a given modality. The visual subnetwork is a pre-trained VGG16 model followed by a bidiretional recurrent layer, while the residual audio subnetwork is based on stacked squeeze-excitation convolutional blocks trained from scratch. After training each subnetwork, the fusion of information from the audio and visual streams is performed at two different stages. The early fusion stage combines features resulting from the last convolutional block of the respective subnetworks at different time steps to feed a bidirectional recurrent structure. The late fusion stage combines the output of the early fusion stage with the independent predictions provided by the two subnetworks, resulting in the final prediction. We evaluate the method using the recently published TAU Audio-Visual Urban Scenes 2021, which contains synchronized audio and video recordings from 12 European cities in 10 different scene classes. The proposed model has been shown to provide an excellent trade-off between prediction performance (86.5%) and system complexity (15M parameters) in the evaluation results of the DCASE 2021 Challenge.


title: Packet Routing with Graph Attention Multi-agent Reinforcement Learning

abstract: Packet routing is a fundamental problem in communication networks that decides how the packets are directed from their source nodes to their destination nodes through some intermediate nodes. With the increasing complexity of network topology and highly dynamic traffic demand, conventional model-based and rule-based routing schemes show significant limitations, due to the simplified and unrealistic model assumptions, and lack of flexibility and adaption. Adding intelligence to the network control is becoming a trend and the key to achieving high-efficiency network operation. In this paper, we develop a model-free and data-driven routing strategy by leveraging reinforcement learning (RL), where routers interact with the network and learn from the experience to make some good routing configurations for the future. Considering the graph nature of the network topology, we design a multi-agent RL framework in combination with Graph Neural Network (GNN), tailored to the routing problem. Three deployment paradigms, centralized, federated, and cooperated learning, are explored respectively. Simulation results demonstrate that our algorithm outperforms some existing benchmark algorithms in terms of packet transmission delay and affordable load.


title: Doubly stochastic Yule cascades (Part II): The explosion problem in the non-reversible case

abstract: We analyze the explosion problem for a class of stochastic models introduced in Part I (arXiv:2103.06912), referred to as doubly stochastic Yule cascades. These models arise naturally in the construction of solutions to evolutionary PDEs as well as in purely probabilistic first passage percolation phenomena having a Markov-type statistical dependence, new for this context. Using cut-set arguments and a greedy algorithm, we respectively establish criteria for non-explosion and explosion without requiring the time-reversibility of the underlying branching Markov chain (a condition required in Part I). Notable applications include the explosion of the self-similar cascade of the Navier-Stokes equations in dimension $d=3$ and non-explosion in dimensions $d\ge 12$.


title: Emergence of surface long-range order under uniform shear flow

abstract: We study the two-dimensional surface long-range order in a non-equilibrium steady state under shear flow using the three-dimensional conserved $O(N)$ model. Whereas the correlation on the surface is enhanced by increasing interactions within the surface, the long-range order cannot be realized at equilibrium because of divergent thermal fluctuations associated with the low dimensionality of the surface. Here, the shear flow is applied parallel to the surface, on which the flow is set to zero. Despite the shear flow not affecting the order parameter on the surface directly, the fluctuations at the surface are strongly suppressed by the flow away from the surface, leading to the surface long-range order. We demonstrate these results through an exact analysis in the large-$N$ limit, where non-linear fluctuations are self-consistently treated.


title: Numerical wave propagation aided by deep learning

abstract: We propose a deep learning approach for wave propagation in media with multiscale wave speed, using a second-order linear wave equation model. We use neural networks to enhance the accuracy of a given inaccurate coarse solver, which under-resolves a class of multiscale wave media and wave fields of interest. Our approach involves generating training data by the given computationally efficient coarse solver and another sufficiently accurate solver, applied to a class of wave media (described by their wave speed profiles) and initial wave fields. We find that the trained neural networks can approximate the nonlinear dependence of the propagation on the wave speed as long as the causality is appropriately sampled in training data. We combine the neural-network-enhanced coarse solver with the parareal algorithm and demonstrate that the coupled approach improves the stability of parareal algorithms for wave propagation and improves the accuracy of the enhanced coarse solvers.


title: Transition from degeneracy to coalescence: theorem and applications

abstract: Exceptional point (EP) is exclusive for non-Hermitian system and distinct from that at a degeneracy point (DP), supporting intriguing dynamics, which can be utilized to probe quantum phase transition and prepare eigenstates in a Hermitian many-body system. In this work, we investigate the transition from DP for a Hermitian system to EP driven by non-Hermitian terms. We present a theorem on the existence of transition between DP and EP for a general system. The obtained EP is robust to the strength of non-Hermitian terms. We illustrate the theorem by an exactly solvable quasi-one-dimensional model, which allows the existence of transition between fully degeneracy and exceptional spectra driven by non-Hermitian tunnelings in real and k spaces, respectively. We also study the EP dynamics for generating coalescing edge modes in Su-Schrieffer-Heeger-like models. This finding reveals the ubiquitous connection between DP and EP.


title: AutoML Meets Time Series Regression Design and Analysis of the AutoSeries Challenge

abstract: Analyzing better time series with limited human effort is of interest to academia and industry. Driven by business scenarios, we organized the first Automated Time Series Regression challenge (AutoSeries) for the WSDM Cup 2020. We present its design, analysis, and post-hoc experiments. The code submission requirement precluded participants from any manual intervention, testing automated machine learning capabilities of solutions, across many datasets, under hardware and time limitations. We prepared 10 datasets from diverse application domains (sales, power consumption, air quality, traffic, and parking), featuring missing data, mixed continuous and categorical variables, and various sampling rates. Each dataset was split into a training and a test sequence (which was streamed, allowing models to continuously adapt). The setting of time series regression, differs from classical forecasting in that covariates at the present time are known. Great strides were made by participants to tackle this AutoSeries problem, as demonstrated by the jump in performance from the sample submission, and post-hoc comparisons with AutoGluon. Simple yet effective methods were used, based on feature engineering, LightGBM, and random search hyper-parameter tuning, addressing all aspects of the challenge. Our post-hoc analyses revealed that providing additional time did not yield significant improvements. The winners' code was open-sourced https://github.com/NehzUx/AutoSeries.


title: Magnetic wire active microrheology of human respiratory mucus

abstract: Mucus is a viscoelastic gel secreted by the pulmonary epithelium in the tracheobronchial region of the lungs. The coordinated beating of cilia moves mucus upwards towards pharynx, removing inhaled pathogens and particles from the airways. The efficacy of this clearance mechanism depends primarily on the rheological properties of mucus. Here we use magnetic wire based microrheology to study the viscoelastic properties of human mucus collected from human bronchus tubes. The response of wires between 5 and 80 microns in length to a rotating magnetic field is monitored by optical time-lapse microscopy and analyzed using constitutive equations of rheology, including those of Maxwell and Kelvin-Voigt. The static shear viscosity and elastic modulus can be inferred from low frequency (from 0.003 to 30 rad s-1) measurements, leading to the evaluation of the mucin network relaxation time. This relaxation time is found to be widely distributed, from one to several hundred seconds. Mucus is identified as a viscoelastic liquid with an elastic modulus of 2.5 +/- 0.5 Pa and a static viscosity of 100 +/- 40 Pa s. Our work shows that beyond the established spatial variations in rheological properties due to microcavities, mucus exhibits secondary inhomogeneities associated with the relaxation time of the mucin network that may be important for its flow properties.


title: On the Properties of the Anisotropic Multivariate Hermite-Gauss Functions

abstract: The Hermite-Gauss basis functions have been extensively employed in classical and quantum optics due to their convenient analytic properties. A class of multivariate Hermite-Gauss functions, the anisotropic Hermite-Gauss functions, arise by endowing the standard univariate Hermite-Gauss functions with a positive definite quadratic form. These multivariate functions admit useful applications in optics, signal analysis and probability theory, however they have received little attention in literature. In this paper, we examine the properties of these functions, with an emphasis on applications in computational optics.


title: Goal-Oriented Script Construction

abstract: The knowledge of scripts, common chains of events in stereotypical scenarios, is a valuable asset for task-oriented natural language understanding systems. We propose the Goal-Oriented Script Construction task, where a model produces a sequence of steps to accomplish a given goal. We pilot our task on the first multilingual script learning dataset supporting 18 languages collected from wikiHow, a website containing half a million how-to articles. For baselines, we consider both a generation-based approach using a language model and a retrieval-based approach by first retrieving the relevant steps from a large candidate pool and then ordering them. We show that our task is practical, feasible but challenging for state-of-the-art Transformer models, and that our methods can be readily deployed for various other datasets and domains with decent zero-shot performance.


title: TableGAN-MCA: Evaluating Membership Collisions of GAN-Synthesized Tabular Data Releasing

abstract: Generative Adversarial Networks (GAN)-synthesized table publishing lets people privately learn insights without access to the private table. However, existing studies on Membership Inference (MI) Attacks show promising results on disclosing membership of training datasets of GAN-synthesized tables. Different from those works focusing on discovering membership of a given data point, in this paper, we propose a novel Membership Collision Attack against GANs (TableGAN-MCA), which allows an adversary given only synthetic entries randomly sampled from a black-box generator to recover partial GAN training data. Namely, a GAN-synthesized table immune to state-of-the-art MI attacks is vulnerable to the TableGAN-MCA. The success of TableGAN-MCA is boosted by an observation that GAN-synthesized tables potentially collide with the training data of the generator. Our experimental evaluations on TableGAN-MCA have five main findings. First, TableGAN-MCA has a satisfying training data recovery rate on three commonly used real-world datasets against four generative models. Second, factors, including the size of GAN training data, GAN training epochs and the number of synthetic samples available to the adversary, are positively correlated to the success of TableGAN-MCA. Third, highly frequent data points have high risks of being recovered by TableGAN-MCA. Fourth, some unique data are exposed to unexpected high recovery risks in TableGAN-MCA, which may attribute to GAN's generalization. Fifth, as expected, differential privacy, without the consideration of the correlations between features, does not show commendable mitigation effect against the TableGAN-MCA. Finally, we propose two mitigation methods and show promising privacy and utility trade-offs when protecting against TableGAN-MCA.


title: Neural Network Approximation of Refinable Functions

abstract: In the desire to quantify the success of neural networks in deep learning and other applications, there is a great interest in understanding which functions are efficiently approximated by the outputs of neural networks. By now, there exists a variety of results which show that a wide range of functions can be approximated with sometimes surprising accuracy by these outputs. For example, it is known that the set of functions that can be approximated with exponential accuracy (in terms of the number of parameters used) includes, on one hand, very smooth functions such as polynomials and analytic functions (see e.g. \cite{E,S,Y}) and, on the other hand, very rough functions such as the Weierstrass function (see e.g. \cite{EPGB,DDFHP}), which is nowhere differentiable. In this paper, we add to the latter class of rough functions by showing that it also includes refinable functions. Namely, we show that refinable functions are approximated by the outputs of deep ReLU networks with a fixed width and increasing depth with accuracy exponential in terms of their number of parameters. Our results apply to functions used in the standard construction of wavelets as well as to functions constructed via subdivision algorithms in Computer Aided Geometric Design.


title: Hypercritical deformed Hermitian-Yang-Mills equation

abstract: In this work, we study the deformed Hermitian-Yang-Mills equation on compact K\"ahler manifold. We introduce the notions of coerciveness and properness of the $\mathcal{J}$-functional on the space of almost calibrated $(1,1)$-forms and show that they are both equivalent to the existence of solutions to the hypercritical deformed Hermitian-Yang-Mills equation.